I work in IT and I have coworkers that use caps lock to capitalize single letters, like the beginning of a sentence. It hurts a bit every time I see it.
I believe you can do this with the on-screen keyboard! If you're using Windows, I think that can be accessed with super+u (but I haven't used Windows in a long time so I apologize if I misremembered or if this is no longer accurate).
Or better yet, start using the US-international keyboard layout. You press the accent you want (', `, ", ~, ...) and the letter you want it on, and boom. Writing normal versions of those symbols requires a space after writing them, but that's easy to get used to.
It's pretty much the default setting in the Netherlands.
We (Canadians) actually have two layouts to type French characters. The modern Canadian multilingual layout, and the traditional "French (Canada)" layout. As an older French speaking Canadian, I prefer the traditional layout but both work. You can even type English words with these.