Hey abrams83
Welcome to Apple Support Communities. From what you describe, it sounds like Full Keyboard Access is in enabled in accessibility.
Full Keyboard Access highlights the item on the screen that has focus.
If you're unsure where to check, follow the steps below.
1. On your Mac, choose Apple menu
> System Settings, then click Accessibility
in the sidebar. (You may need to scroll down.)
2. Go to Motor on the right, click Keyboard, then turn on Full Keyboard Access.
Click the Info button
to change the appearance of Full Keyboard Access (for example, the outline color). Click Commands to see a complete list of Full Keyboard Access commands, customize keyboard shortcuts for default commands, set shortcuts for advanced commands, or restore default shortcuts.
When you get to the 2nd step, turn off Full Keyboard Access and see if the border is still there. For more information about using Full Keyboard Access, review this article: Navigate your Mac using Full Keyboard Access. There's more details about using the Full Keyboard Access.
Take care.