DRILL-8525: Migrate Fully to Apache Commons Collections 4.x

[rymarm]

DRILL-8525: Migrate Fully to Apache Commons Collections 4.x

Description

To my surprise, Drill still uses classes from commons-collections (3.x release) in a few places, and Drill has not even declared it as a dependency. Drill used transitive dependency from hadoop-commons:

[INFO] --- dependency:3.6.1:tree (default-cli) @ drill-java-exec ---
[INFO] org.apache.drill.exec:drill-java-exec:jar:1.22.0-SNAPSHOT
[INFO] +- org.apache.hadoop:hadoop-common:jar:3.3.6:compile
[INFO] |  \- commons-collections:commons-collections:jar:3.2.2:compile
[INFO] \- org.apache.commons:commons-collections4:jar:4.4:compile

But starting from 3.4.2 release, Hadoop drops it: https://issues.apache.org/jira/browse/HADOOP-15760
Time to clean our code too and completely migrate to 4.x :)

Documentation

No user-visible changes

Testing

Unit tests

[cgivre]

LGTM +1.
Thanks for catching this. I don't know if this would be out of scope for this PR, but would it make sense to bump the Hadoop version to the latest version, or is that a separate PR?

[rymarm]

@cgivre At first, I wanted to bump Hadoop version, but then checked the release notes, and I think it will be better to double check it, and make changes to Drill if needed, like, for example, for this:

Use modified jersey-json 1.20 in https://github.com/pjfanning/jersey-1.x/tree/v1.20 that uses Jackson 2.x. By this change, Jackson 1.x dependency has been removed from Hadoop. downstream applications which explicitly exclude jersey from transitive dependencies must now exclude com.github.pjfanning:jersey-json

Let's do it in a separate PR.

https://hadoop.apache.org/docs/r3.4.0/hadoop-project-dist/hadoop-common/release/3.4.0/RELEASENOTES.3.4.0.html
https://hadoop.apache.org/docs/r3.4.1/hadoop-project-dist/hadoop-common/release/3.4.1/RELEASENOTES.3.4.1.html