In this talk, I will provide an overview of my research on advancing beyond the traditional supervised deep learning paradigm to create more affordable and reliable visual autonomous systems. I will discuss how sensor costs, labeling efforts, and safety-critical issues play a role in this field of research. Additionally, I will delve into more details on my two recent projects, which focus on reducing manual annotation costs through the use of active learning.