Although the myth that drinking significant amounts of coffee within a short period of time can cause palpitations have long been debunked, heart palpitations is very much evident during coffee withdrawal. Reports have said that caffeine affects the heart rate and people claim they feel their heart rhythm change after letting coffee go.