The demand for electronic devices has dramatically increased in the past few years. Efficient electronic devices require excellent thermal management systems to extend their operation time and prevent heat accumulation from affecting performance. Carbonaceous materials are considered as one of the ideal thermal management materials due to their excellent physiochemical stability. In addition, since porous-structured carbon materials typically exhibit outstanding thermal conductivity, low density, and large contact area, they have attracted considerable attention from both academia and industry in the last decades. In this review, methods and strategies for the preparation of highly thermally conductive porous carbon-based materials and the factors that influence their thermal conductivity of the materials are summarized. The thermal performance of porous carbonaceous materials fabricated by different approaches and their applications are also discussed. Finally, the potential challenges and strategies for the development and applications of highly thermally conductive porous carbonaceous materials are discussed.