Inflation Even Hurts the Penguins