Record · corpus.blog/posts/01a0d053-12ed-727a-a76d-2a8f3d67e991

Unlocking Efficiency and Performance: Navigating the Spark 3 and EMR 6 Upgrade Journey at Slack

Engineering at Slack · published 2 July 2024

A record is what was published and who pointed at it. The text of the post is not held here: read it at the source, or at its Wayback capture.

Read the post at slack.engineering Wayback capture

0blogs citing

First cited: —
Most recent: —
Rank this month: not ranked
Links from this post: 24
Words captured: 2,121

Cited by

No blog we hold has cited this post yet.

Links from this post

Link

Host

https://aws.amazon.com/emr/

aws.amazon.com

https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-release-5x.html

docs.aws.amazon.com

https://hive.apache.org/

hive.apache.org

https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-release-6x.html

docs.aws.amazon.com

https://spark.apache.org/news/spark-3-0-0-released.html

spark.apache.org

https://spark.apache.org/docs/latest/sql-performance-tuning.html

spark.apache.org

https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-log4j-vulnerability.html

docs.aws.amazon.com

https://aws.amazon.com/blogs/big-data/upgrade-amazon-emr-hive-metastore-from-5-x-to-6-x/

aws.amazon.com

https://aws.amazon.com/emr

aws.amazon.com

https://aws.amazon.com/pm/serv-s3/?gclid=Cj0KCQjwxeyxBhC7ARIsAC7dS39RjvF_KIxEF_GegmFglhJi6k5YOKB5B4OPDm0e57XpvfIyMAJ43ZUaAm2HEALw_wcB&trk=20e04791-939c-4db9-8964-ee54c41bc6ad&sc_channel=ps&ef_id=Cj0KCQjwxeyxBhC7ARIsAC7dS39RjvF_KIxEF_GegmFglhJi6k5YOKB5B4OPDm0e57XpvfIyMAJ43ZUaAm2HEALw_wcB:G:s&s_kwcid=AL!4422!3!651751060962!e!!g!!amazon%20s3%20account!19852662362!145019251177

aws.amazon.com

https://aws.amazon.com/rds/

aws.amazon.com

https://airflow.apache.org/

airflow.apache.org

https://livy.incubator.apache.org/docs/latest/rest-api.html

livy.incubator.apache.org

https://cwiki.apache.org/confluence/display/Hive/Hive+Schema+Tool

cwiki.apache.org

https://docs.aws.amazon.com/sdk-for-go/api/service/emr/

docs.aws.amazon.com

https://docs.aws.amazon.com/emr/latest/APIReference/API_RunJobFlow.html

docs.aws.amazon.com

https://bazel.build/

bazel.build

https://spark.apache.org/docs/latest/sql-ref-ansi-compliance.html

spark.apache.org

https://spark.apache.org/docs/latest/sql-data-sources-parquet.html

spark.apache.org

https://trino.io/

trino.io

https://spark.apache.org/docs/3.1.3/api/python/reference/api/pyspark.sql.functions.greatest.html

spark.apache.org

https://airflow.apache.org/docs/apache-airflow/stable/database-erd-ref.html

airflow.apache.org

https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-spark-s3-optimized-committer.html

docs.aws.amazon.com

https://slack.com/careers

slack.com