Yes, we preach about not delivering the perfect product, but the product that is good enough.
This is not a question of quality but one of feature selection. Your product has to solve a problem for the customer in a reliable way and it really helps if the customer enjoys the experience. Simple design and singularity of purpose are the goal here. If you nail your value proposition through a diligent customer discovery process, you will learn what features and functions are most important and you can concentrate on delivering those with quality and elegance.