fix: Fix to_json handling of NaN and Infinity values (#3016) #3887

Job	Run time
macos-14/Spark 3.5, JDK 17, Scala 2.13 [sql]	43m 5s
macos-14/Spark 3.4, JDK 11, Scala 2.12 [exec]	53m 43s
macos-14/Spark 3.5, JDK 17, Scala 2.13 [fuzz]	1h 12m 6s
macos-14/Spark 3.5, JDK 17, Scala 2.13 [parquet]	46m 56s
macos-14/Spark 3.4, JDK 11, Scala 2.12 [fuzz]	1h 38m 52s
macos-14/Spark 3.4, JDK 11, Scala 2.12 [expressions]	49m 53s
macos-14/Spark 4.0, JDK 17, Scala 2.13 [fuzz]	1h 18m 32s
macos-14/Spark 4.0, JDK 17, Scala 2.13 [expressions]	41m 54s
macos-14/Spark 4.0, JDK 17, Scala 2.13 [exec]	46m 4s
macos-14/Spark 3.4, JDK 11, Scala 2.12 [parquet]	1h 3m 35s
macos-14/Spark 4.0, JDK 17, Scala 2.13 [shuffle]	1h 5m 8s
macos-14/Spark 4.0, JDK 17, Scala 2.13 [sql]	39m 31s
macos-14/Spark 3.4, JDK 11, Scala 2.12 [sql]	34m 26s
macos-14/Spark 4.0, JDK 17, Scala 2.13 [parquet]	59m 27s
macos-14/Spark 3.5, JDK 17, Scala 2.13 [exec]	45m 6s
macos-14/Spark 3.5, JDK 17, Scala 2.13 [shuffle]	1h 4m 1s
macos-14/Spark 3.5, JDK 17, Scala 2.13 [expressions]	51m 46s
macos-14/Spark 3.4, JDK 11, Scala 2.12 [shuffle]	52m 27s
	16h 46m 32s

Provide feedback