I had to create an interior camera of my object and for that to work I had to offset my object from the center. Now the problem is that I want the camera to rotate from the center of the object and not around the center of my scene. Here are some images one two three that will explain the problem. As you can see, looking at the car from the back it appears closer than looking from the front.

// Camera
const fov = 75;
const near = 0.1;
const far = 1000;
const camera = new THREE.PerspectiveCamera(fov, window.innerWidth / window.innerHeight, near, far);
camera.position.set(0, 1, 4);

// Camera Controls
const controls = new THREE.OrbitControls(camera, renderer.domElement);
controls.maxPolarAngle = Math.PI / 2;
controls.minPolarAngle = Math.PI / 3;
controls.maxDistance = 5;
controls.minDistance = 3;
controls.autoRotate = true;
controls.autoRotateSpeed = 0.2;
controls.enableDamping = true;
controls.enablePan = false;
controls.addEventListener( "change", event => {
console.log( controls.object.position );
});
controls.update()