The increasing demand for the development of environmentally friendly alternatives to petroleum-derived materials has increased research efforts on sustainable polymer composites. This study systematically examined the effect of nano-biochar derived from agricultural wastes such as olive pulp on the mechanical and thermal properties of epoxy-resin-based composites. First, the biochar from olive pulp was produced by pyrolysis at 450 °C and turned to nano-biochar using ball milling. Composite samples containing nano-biochar at different rates between 0 and 10% were prepared. The nano-biochar and composite samples were characterized by using different techniques such as SEM-EDS, BET, FTIR, XRD, Raman, TGA, and DMA analyses. Also, the tensile strength, elastic modulus, Shore D hardness, thermal stability, and static toughness of the composite samples were evaluated. The best performance was observed in the sample containing 6% nano-biochar; the ultimate tensile strength increased from 17.37 MPa to 23.46 MPa compared to pure epoxy, and the elastic modulus and hardness increased. However, a decrease in brittleness and toughness was observed at higher additive rates. FTIR and DMA analyses indicated that the nano-biochar interacted strongly with the epoxy matrix and increased its thermal stability. The results showed that the olive-pulp-derived nano-biochar could be used to improve the structural and thermal properties of the epoxy composites as an inexpensive and environmentally friendly filler. As a result, this study contributes to the production of new polymer-based materials that will encourage the production of environmentally friendly composites with nano-scale biochar obtained from olive waste, which is an easily accessible, renewable by-product.