A good set of books if you want a more technical treatment of the
auditory system is
"Neurobiology of Hearing: The Cochlea", Altschuler et al. Editors,
Raven Press, 1986
"Neurobiology of Hearing: The Central Auditory System", Altschuler et al.
Editors, Raven Press, 1991
They are somewhat out of date, but contain work from many of the major
researchers in the field, and are thus a good jumping off place if you
want to get into the primary literature.
Brian Kingsbury bedk at icsi.berkeley.edu