To remain competitive, single-family wooden house builders might create smart wooden house factories. Smart factories and smart production are recent concepts used to denote ideas that support competitiveness in for example the automotive industry. In the housing sector, a concept introduced to increase competitiveness is industrialized house-building. The aim of the study presented here was to investigate whether industrialized house-building characteristics could be a step toward a smart factory for wooden house builders. In this paper, ideas of the smart wooden house factory are synthesized, and challenges for the single-family wooden house builder are identified. The study is founded on empirical data from one single-case study. A challenge identified was the maturity level of the culture and organization to commit to and utilize modern technology and modern working methods. The concept of the smart wooden house factory is still in its infancy and needs further research.