I follow what you wrote in the manual. I drop in my sounds and then use Audio Cortex to find what I need. Usually most of my sounds have names so it will find them by name but also category which groups them nicely. As you wrote, at the moment it is rather tailored towards music production.
What I like about the Spectrograph is that you can see how the sound »looks« which is really helpful if I want to match it to a certain kind of animation that has movement that is similar to the visual representation of the sound.
I wrote you an e-mail regarding training the AI. I already started analyzing some of my sound effect libraries and will gladly provide them for your model building. All the best, René