can monolith load data from hdfs?
Author: colinlzhCreated Oct 11, 2023Updated Oct 23, 2023
we are deploying monolith on our environment. we manage our data by pyspark. So usually we have a pyspark dataframe as data input. In demos, monolith can load data from tdfs or kafka. I was wondering that can monolith surpport loading data from pyspark dataframe or hdfs dir? Or we have to dump files from pyspark to local memory to let monolith load it?
Source: bytedance/monolith