If you use a decent (high resolution γ-ray) detector, you'll find that the background (from UK concrete, at least) is dominated by the ⁴⁰K decay line, whose energy might be ingrained in ex-γ-ray spectroscopists years later. Geiger counters may indicate radiation, but not what radiation.