It really depends on application and complexity of object graph. Short lived object usually have low overhead. Long lived objects with huge heap may cause a problem.
In past GC had bad reputation for increased and unpredictable latencies. In old JVMs GC would pause execution to traverse object graph.
In general do not worry about GC, unless you run into performance issues. If performance is a problem, run continuous profiler such as Flight Recorded. It has very little overhead.
And in most cases it isn't GC which is the problem, but the program doing too many heap allocations. Cutting heap allocations down improves the speed of most programs, with or without GC.
In past GC had bad reputation for increased and unpredictable latencies. In old JVMs GC would pause execution to traverse object graph.
In general do not worry about GC, unless you run into performance issues. If performance is a problem, run continuous profiler such as Flight Recorded. It has very little overhead.