GitHub Trends
10.1K subscribers
15.3K links
See what the GitHub community is most excited about today.

A bot automatically fetches new repositories from https://github.com/trending and sends them to the channel.

Author and maintainer: https://github.com/katursis
Download Telegram
#python #analytics #dagster #data_engineering #data_integration #data_orchestrator #data_pipelines #data_science #etl #metadata #mlops #orchestration #python #scheduler #workflow #workflow_automation

Dagster is a tool that helps you manage and automate your data workflows. You can define your data assets, like tables or machine learning models, using Python functions. Dagster then runs these functions at the right time and keeps your data up-to-date. It offers features like integrated lineage and observability, making it easier to track and manage your data. This tool is useful for every stage of data development, from local testing to production, and it integrates well with other popular data tools. Using Dagster, you can build reusable components, spot data quality issues early, and scale your data pipelines efficiently. This makes your work more productive and helps maintain control over complex data systems.

https://github.com/dagster-io/dagster
👍1
#java #cache #distributed #distributed_locks #executor #hibernate #java #json #lock #map #micronaut #quarkus #queue #redis #redis_client #scheduler #session #spring #tomcat #valkey #valkey_client

Redisson is a powerful Java client for Redis and other real-time data platforms. It offers high-performance, thread-safe, and asynchronous connections, making it ideal for complex applications. You can use it with various deployment types, such as single, cluster, sentinel, and more, and it is compatible with major cloud services like AWS, Azure, and Google Cloud. Redisson supports many features like distributed locks, counters, collections, and services, as well as integration with popular frameworks like Spring and Micronaut. This makes it easier to manage and scale your data efficiently, ensuring reliability and performance in your applications.

https://github.com/redisson/redisson
#python #airflow #apache #apache_airflow #automation #dag #data_engineering #data_integration #data_orchestrator #data_pipelines #data_science #elt #etl #machine_learning #mlops #orchestration #python #scheduler #workflow #workflow_engine #workflow_orchestration

Apache Airflow is a tool that helps you manage and automate workflows. You can write your workflows as code, making them easier to maintain, version, test, and collaborate on. Airflow lets you schedule tasks and monitor their progress through a user-friendly interface. It supports dynamic pipeline generation, is highly extensible, and scalable, allowing you to define your own operators and executors.

Using Airflow benefits you by making your workflows more organized, efficient, and reliable. It simplifies the process of managing complex tasks and provides clear visualizations of your workflow's performance, helping you identify and troubleshoot issues quickly. This makes it easier to manage data processing and other automated tasks effectively.

https://github.com/apache/airflow
👍1
#typescript #expressjs #postgresql #project_management #react #resource_management #rest_api #scheduler #task_management #time_tracking #typescript

Worklenz is a tool that helps teams manage projects better. It offers features like task management, time tracking, and collaboration tools. This means you can easily assign tasks, track how much time is spent on them, and work together with your team. Worklenz also provides analytics to help you understand how your projects are going and make good decisions. It simplifies workflows, reduces errors, and saves time, which can help your business run more smoothly and efficiently[1][2][3].

https://github.com/Worklenz/worklenz