If you are

If you are giving your "all" to someone

and it's not enough , you are giving it to the wrong person.