Spark 流式或批处理

问题描述 投票:0回答:1

我正在尝试构建一个应用程序,我需要偶尔读取另一个应用程序放置的文件,每天一次或两次。我必须创建一个 Spark ETL 来监听这个文件夹。收到文件后,读取文件,进行一些转换并将数据加载到数据库。 我如何实现这个项目的听力部分。我们应该为此使用 Spark 流吗?

我正在考虑 Spark Streaming,但看起来它更适合连续流式传输的东西。所以我很困惑。

batch-file pyspark bigdata streaming etl
1个回答
-1
投票
We consistently offer reasonable ISO 9001 certification costs in Nepal, so don't worry. Following installation, we guarantee certification. If you consult with us, you cannot fail the audit. So, why do you hesitate? Don't you want to establish your own brand value and become well-known around the world? Are you not interested in obtaining government contracts and all the other benefits mentioned? The decision is entirely yours; if the answer is no, stay where you are, and if the answer is yes, all you need to do is send us an email at [email protected] . Alternatively, you may visit our website at www.certvalue.com  and complete the pop-up form there to assist us in getting in touch with you as soon as possible.

https://www.certvalue.com/iso-9001-certification-in-nepal/

© www.soinside.com 2019 - 2024. All rights reserved.