Basic Info

• Email: linfanxiaolinda@outlook.com
• Github: https://github.com/largecats
• Blog: https://largecats.github.io/blog/
• LinkedIn: https://www.linkedin.com/in/linfan-xiao/
• Location: Shenzhen/Singapore

Education

• Yale-NUS College (2015-08 - 2019-06): Bachelor of Science with Honours in Mathematical, Computational, and Statistical Sciences
• National University of Singapore (2022-08 - 2024-01): Master of Computing (Computer Science)

Experiences

• Data engineer at Sea Limited (2019-08 - 2021-06)
• Data engineer at Bytedance (2021-07 - 2022-08)

Projects

Work

• spark-sql-formatter: https://github.com/largecats/sparksql-formatter
• pyspark-sql-formatter: https://github.com/largecats/pyspark-sql-formatter

Academic

• Honours thesis: https://github.com/largecats/capstone-project
• Study notes: https://github.com/largecats/the-c-programming-language-notes

Fun

• comics-ocr: https://github.com/largecats/comics-ocr

Technical Articles

• Stream Processing 101
• Spark Magnet: Push-based Shuffle
• Variance in Type Systems
• Caching in Spark
• Collecting Log in Spark Cluster Mode