If you are an owner of a Distribution List, you can manage members via Address book in Outlook desktop client. You can just open Address book and double click the DL to modify the members.

For Outlook on the web, you can click gear icon to open Settings > General > Distribution groups, then you can manage the members.