I found a local shop that will do diagnosis for free so I took it there and it turned out to be the PCV valve causing the noise. The guy took off the oil cap while the engine was running and the noise stopped. I picked up the kit from Advance today and that took care of it. One of the O-rings that came in the kit was missing from the car so that could have been all it needed.