This small piece you are referring to is a back flow preventor. Leave this in the system. With the info provided, it is probable that you are overcarbonating the beer. What line sizes and lengths are you using?
Scott Zuhse, Instructor
Micro Matic Dispense Institute