After diet, rest could be the next biggest factor that affects your body’s testosterone manufacturing