Existing models to explain human psychophysics or neural responses are typically designed for a specific stimulus type and often fail for other stimuli. The ultimate goal for a neural model is to simulate responses to many stimuli, which may provide better insights into neural mechanisms. We tested the ability of modified same-frequency inhibition-excitation models for inferior colliculus neurons to simulate individual neuron responses to both amplitude-modulated sounds and tone-in-noise stimuli. Modifications to the model were guided by receptive fields computed with 2nd-order Wiener kernel analysis. This approach successfully simulated many individual neurons' responses to different types of stimuli. Other neurons suggest limitations and future directions for modeling efforts. © 2018 The Author(s). Published by S. Hirzel Verlag · EAA. This is an open access article under the terms of the Creative Commons Attribution (CC BY 4.0) license (https://creativecommons.org/licenses/by/4.0/).