Telemedicine implementations often remain in the pilot phase and do not succeed in scaling-up to robust products that are used in daily practice. We conducted a qualitative literature review of 45 conference papers describing telemedicine interventions in order to identify determinants that had influenced their implementation. The identified determinants, which would influence the future implementation of telemedicine interventions, can be classified into five major categories: (i) Technology, (ii) Acceptance (iii) Financing, (iv) Organization and (v) Policy and Legislation. Each category contains determinants that are relevant to different stakeholders in different domains. We propose a layered implementation model in which the primary focus on individual determinants changes throughout the development life cycle of the telemedicine implementation. For success, a visionary approach is required from the multidisciplinary stakeholders, which goes beyond tackling specific issues in a particular development phase. Thus the right philosophy is: ‘start small, think big’.