Joint 2D object detection and 3D reconstruction is an essential computer vision task to get more accurate detection and representation model of the target object. We proposed a novel joint 2D object detection and 3D reconstruction model that enhances the ability of the 2D object detection and the 3D reconstruction, called Adversarial Fusion Mesh Region Convolutional Neural Networks (AFM R-CNN). Our proposed model introduces the Deep Convolutional Generative Adversarial Network to generate adversarial images and input the real and adversarial images into the object detection module GA-RPN to determine the position and anchor box of the target object. Next, the voxel conversion and Fusion model Pix2Vox is introduced to fuse the two types of image features and generate coarse voxels. Afterwards, we use the Principal Neighborhood Aggregation network model in 3D model refinement.