The museum is housed in two classical villas on the Untermainkai, across the Main from the Schaumainkai.
The building stands on the Schaumainkai, in a garden in which a number of sculptures are also on display, including a replica of Dannecker's Ariadne on the Panther.
The museum has expanded since 1973 and now occupies three adjacent buildings on the Schaumainkai – nos. 29 (the main building), 35 (the original villa), and 37 ("Gallery 37"), which were acquired and/or rebuilt in the 1980s.
The street itself is called Schaumainkai and is often partially closed to traffic for Frankfurt's largest flea market each Saturday.
Because of the large concentration of museums on the riverside, the area is called Museumsufer ("Museum Embankment").