Thanks, Jesus! (Man, have I been waiting to use that one) The first gasket isn't in the flow path, I just have it badly centered. If anything, the second gasket seems oversized.
I ended up using two gaskets on each joint. That seems to have helped the issue. I like that idea of using the flat surface and sandpaper, I'll definitely try that in the future.