The MPI optimized modeler is a web-based platform that facilitates modeling of complex optimization problems. Our goal is to assess whether the combination of a direct-manipulation interface and use of an interactive bricks paradigm similar to a block based-visual programming language such as Scratch, facilitates the creation of optimization models in the Optimized Modeler. Our hypothesis is that it speeds up the modeling and implementation process and leads to better formulations in the end. However, having a subjectively good application from only a developer’s point of view is not enough when it comes to designing a good and useable system. Thus, in order to have a systemized and scientific approach to both being able to test this hypothesis and to meet future user testing needs, we are building a tailor-made web-based user study system that can facilitate running remote user studies for the Optimized Modeler.