Although Simon and Garfunkel's voices were made for each other, Paul Simon felt some songs were off limits for the duo.