Contact your local zoning office to see if the pole violates any ordinances.
In some communities, mailboxes must be a break-away type. See if the pole needs to be classified the same.
Maybe it qualifies as a sign pole, and the maximum height a sign can be in a residential neighborhood is four feet.
You may have to think creatively, as in my two examples.
Then again, what kind of trouble might those teens get into without a hoop to play ball? It might be doing more good, than the inconvenience to you. Remember, you sometimes have to be careful what you wish for.
Do you want to be known as the person who ruined their fun?