Well if you're only talking about Spanish and Chinese, the correct wording is:

Anyway, Spanish is probably the easier second language for English speakers and Chinese the more challenging

Otherwise, without qualifying a range, it sounds like you're saying Spanish is the easiest of all second languages and Chinese the hardest.

There are dozens of languages that are surely more challenging than Chinese for many or most English speakers. Japanese, Greek and Russian, to name a few.