[AURON #2307] Add @transient to large fields and use NativePartition to reduce serialization overhead #5896

Run time

Learn about OS pricing on GitHub Actions

Job	Run time
Test spark-3.2 / Build Auron JAR	35m 19s
Test spark-3.5 JDK17 Scala-2.13 / Build Auron JAR	35m 21s
Test spark-4.0 JDK21 Scala-2.13 / Build Auron JAR	28m 42s
Test spark-3.4 / Build Auron JAR	35m 23s
Test spark-3.5 JDK21 Scala-2.13 / Build Auron JAR	35m 23s
Test spark-3.1 / Build Auron JAR	32m 45s
Test spark-4.2 JDK21 Scala-2.13 / Build Auron JAR	25m 5s
Test spark-3.3 / Build Auron JAR	28m 9s
Test spark-3.0 / Build Auron JAR	25m 14s
Test spark-4.1 JDK21 Scala-2.13 / Build Auron JAR	26m 25s
Test spark-4.2 JDK21 Scala-2.13 / Run TPC-DS test q50,q51,q52,q53,q54,q55,q56,q57,q58,q59	8m 24s
Test spark-4.2 JDK21 Scala-2.13 / Run TPC-DS test q10,q11,q12,q13,q14a,q14b,q15,q16,q17,q18,q19	8m 24s
Test spark-4.2 JDK21 Scala-2.13 / Run TPC-DS test q60,q61,q62,q63,q64,q65,q66,q67,q68,q69	8m 25s
Test spark-4.2 JDK21 Scala-2.13 / Run TPC-DS test q20,q21,q22,q23a,q23b,q24a,q24b,q25,q26,q27,q28,q29	8m 24s
Test spark-4.2 JDK21 Scala-2.13 / Run TPC-DS test q90,q91,q92,q93,q94,q95,q96,q97,q98,q99	8m 25s
Test spark-4.2 JDK21 Scala-2.13 / Run TPC-DS test q1,q2,q3,q4,q5,q6,q7,q8,q9	8m 24s
Test spark-4.2 JDK21 Scala-2.13 / Run TPC-DS test q30,q31,q32,q33,q34,q35,q36,q37,q38,q39a,q39b	8m 24s
Test spark-4.2 JDK21 Scala-2.13 / Run TPC-DS test q80,q81,q82,q83,q84,q85,q86,q87,q88,q89	8m 25s
Test spark-4.2 JDK21 Scala-2.13 / Run TPC-DS test q40,q41,q42,q43,q44,q45,q46,q47,q48,q49	8m 24s
Test spark-4.2 JDK21 Scala-2.13 / Run TPC-DS test q70,q71,q72,q73,q74,q75,q76,q77,q78,q79	8m 25s
Test spark-4.1 JDK21 Scala-2.13 / Run TPC-DS test q80,q81,q82,q83,q84,q85,q86,q87,q88,q89	8m 20s
Test spark-4.1 JDK21 Scala-2.13 / Run TPC-DS test q60,q61,q62,q63,q64,q65,q66,q67,q68,q69	8m 20s
Test spark-4.1 JDK21 Scala-2.13 / Run TPC-DS test q1,q2,q3,q4,q5,q6,q7,q8,q9	8m 19s
Test spark-4.1 JDK21 Scala-2.13 / Run TPC-DS test q50,q51,q52,q53,q54,q55,q56,q57,q58,q59	8m 19s
Test spark-4.1 JDK21 Scala-2.13 / Run TPC-DS test q90,q91,q92,q93,q94,q95,q96,q97,q98,q99	8m 20s
Test spark-4.1 JDK21 Scala-2.13 / Run TPC-DS test q30,q31,q32,q33,q34,q35,q36,q37,q38,q39a,q39b	8m 19s
Test spark-4.1 JDK21 Scala-2.13 / Run TPC-DS test q70,q71,q72,q73,q74,q75,q76,q77,q78,q79	8m 20s
Test spark-4.1 JDK21 Scala-2.13 / Run TPC-DS test q20,q21,q22,q23a,q23b,q24a,q24b,q25,q26,q27,q28,q29	8m 19s
Test spark-4.1 JDK21 Scala-2.13 / Run TPC-DS test q10,q11,q12,q13,q14a,q14b,q15,q16,q17,q18,q19	8m 19s
Test spark-4.1 JDK21 Scala-2.13 / Run TPC-DS test q40,q41,q42,q43,q44,q45,q46,q47,q48,q49	8m 19s
Test spark-3.0 / Run TPC-DS test q30,q31,q32,q33,q34,q35,q36,q37,q38,q39a,q39b	8m 16s
Test spark-3.0 / Run TPC-DS test q50,q51,q52,q53,q54,q55,q56,q57,q58,q59	8m 16s
Test spark-3.0 / Run TPC-DS test q70,q71,q72,q73,q74,q75,q76,q77,q78,q79	8m 17s
Test spark-3.0 / Run TPC-DS test q40,q41,q42,q43,q44,q45,q46,q47,q48,q49	8m 16s
Test spark-3.0 / Run TPC-DS test q60,q61,q62,q63,q64,q65,q66,q67,q68,q69	8m 17s
Test spark-3.0 / Run TPC-DS test q20,q21,q22,q23a,q23b,q24a,q24b,q25,q26,q27,q28,q29	8m 16s
Test spark-3.0 / Run TPC-DS test q1,q2,q3,q4,q5,q6,q7,q8,q9	8m 16s
Test spark-3.0 / Run TPC-DS test q80,q81,q82,q83,q84,q85,q86,q87,q88,q89	8m 17s
Test spark-3.0 / Run TPC-DS test q90,q91,q92,q93,q94,q95,q96,q97,q98,q99	8m 17s
Test spark-3.0 / Run TPC-DS test q10,q11,q12,q13,q14a,q14b,q15,q16,q17,q18,q19	8m 16s
Test spark-3.3 / Run TPC-DS test q50,q51,q52,q53,q54,q55,q56,q57,q58,q59	6m 37s
Test spark-3.3 / Run TPC-DS test q1,q2,q3,q4,q5,q6,q7,q8,q9	6m 37s
Test spark-3.3 / Run TPC-DS test q30,q31,q32,q33,q34,q35,q36,q37,q38,q39a,q39b	6m 37s
Test spark-3.3 / Run TPC-DS test q10,q11,q12,q13,q14a,q14b,q15,q16,q17,q18,q19	6m 37s
Test spark-3.3 / Run TPC-DS test q60,q61,q62,q63,q64,q65,q66,q67,q68,q69	6m 38s
Test spark-3.3 / Run TPC-DS test q40,q41,q42,q43,q44,q45,q46,q47,q48,q49	6m 37s
Test spark-3.3 / Run TPC-DS test q70,q71,q72,q73,q74,q75,q76,q77,q78,q79	6m 38s
Test spark-3.3 / Run TPC-DS test q90,q91,q92,q93,q94,q95,q96,q97,q98,q99	6m 38s
Test spark-3.3 / Run TPC-DS test q20,q21,q22,q23a,q23b,q24a,q24b,q25,q26,q27,q28,q29	6m 37s
Test spark-3.3 / Run TPC-DS test q80,q81,q82,q83,q84,q85,q86,q87,q88,q89	6m 38s
Test spark-4.0 JDK21 Scala-2.13 / Run TPC-DS test q10,q11,q12,q13,q14a,q14b,q15,q16,q17,q18,q19	6m 3s
Test spark-4.0 JDK21 Scala-2.13 / Run TPC-DS test q50,q51,q52,q53,q54,q55,q56,q57,q58,q59	6m 3s
Test spark-4.0 JDK21 Scala-2.13 / Run TPC-DS test q90,q91,q92,q93,q94,q95,q96,q97,q98,q99	6m 4s
Test spark-4.0 JDK21 Scala-2.13 / Run TPC-DS test q20,q21,q22,q23a,q23b,q24a,q24b,q25,q26,q27,q28,q29	6m 3s
Test spark-4.0 JDK21 Scala-2.13 / Run TPC-DS test q1,q2,q3,q4,q5,q6,q7,q8,q9	6m 3s
Test spark-4.0 JDK21 Scala-2.13 / Run TPC-DS test q80,q81,q82,q83,q84,q85,q86,q87,q88,q89	6m 4s
Test spark-4.0 JDK21 Scala-2.13 / Run TPC-DS test q60,q61,q62,q63,q64,q65,q66,q67,q68,q69	6m 4s
Test spark-4.0 JDK21 Scala-2.13 / Run TPC-DS test q40,q41,q42,q43,q44,q45,q46,q47,q48,q49	6m 3s
Test spark-4.0 JDK21 Scala-2.13 / Run TPC-DS test q70,q71,q72,q73,q74,q75,q76,q77,q78,q79	6m 4s
Test spark-4.0 JDK21 Scala-2.13 / Run TPC-DS test q30,q31,q32,q33,q34,q35,q36,q37,q38,q39a,q39b	6m 3s
Test spark-3.1 / Run TPC-DS test q60,q61,q62,q63,q64,q65,q66,q67,q68,q69	2m 1s
Test spark-3.1 / Run TPC-DS test q30,q31,q32,q33,q34,q35,q36,q37,q38,q39a,q39b	2m 0s
Test spark-3.1 / Run TPC-DS test q70,q71,q72,q73,q74,q75,q76,q77,q78,q79	2m 1s
Test spark-3.1 / Run TPC-DS test q50,q51,q52,q53,q54,q55,q56,q57,q58,q59	2m 0s
Test spark-3.1 / Run TPC-DS test q20,q21,q22,q23a,q23b,q24a,q24b,q25,q26,q27,q28,q29	2m 0s
Test spark-3.1 / Run TPC-DS test q80,q81,q82,q83,q84,q85,q86,q87,q88,q89	2m 1s
Test spark-3.1 / Run TPC-DS test q40,q41,q42,q43,q44,q45,q46,q47,q48,q49	2m 0s
Test spark-3.1 / Run TPC-DS test q1,q2,q3,q4,q5,q6,q7,q8,q9	2m 0s
Test spark-3.1 / Run TPC-DS test q90,q91,q92,q93,q94,q95,q96,q97,q98,q99	2m 1s
Test spark-3.1 / Run TPC-DS test q10,q11,q12,q13,q14a,q14b,q15,q16,q17,q18,q19	2m 0s
Test spark-3.2 / Run TPC-DS test ${{ matrix.query }}	1s
Test spark-3.5 JDK17 Scala-2.13 / Run TPC-DS test ${{ matrix.query }}	1s
Test spark-3.5 JDK21 Scala-2.13 / Run TPC-DS test ${{ matrix.query }}	1s
Test spark-3.4 / Run TPC-DS test ${{ matrix.query }}	1s
	11h 44m 44s

Navigation Menu

[AURON #2307] Add @transient to large fields and use NativePartition to reduce serialization overhead #5896

Usage

[AURON #2307] Add @transient to large fields and use NativePartition to reduce serialization overhead #5896

Uh oh!

Run time