So minister to both groups without unrealistic expectations. You do what you can. Don't enable. Don't be easy. Love but with boundaries.
If you do this without trying to hobble yourself with impossible measurements you will be doing the work of God. Let the Holy Spirit do HIS work.. and you ain't Him.