What do atomic operations accomplish?

I've been trying to learn rust and have been struggling to understand what Arcs accomplish. I know that it means atomically reference counted variables, but what is the difference between reference counted and atomically reference counted.

The reading I've done says it's "all at once" and not split between many operations. But what does that accomplish in this context?