GitHub Trends
10.1K subscribers
15.3K links
See what the GitHub community is most excited about today.

A bot automatically fetches new repositories from https://github.com/trending and sends them to the channel.

Author and maintainer: https://github.com/katursis
Download Telegram
#java #batch #cdc #change_data_capture #data_integration #data_pipeline #distributed #elt #etl #flink #kafka #mysql #paimon #postgresql #real_time #schema_evolution

Flink CDC is a tool that helps you move and transform data in real-time or in batches. It makes data integration simple by using YAML files to describe how data should be moved and transformed. This tool offers features like full database synchronization, table sharding, schema evolution, and data transformation. To use it, you need to set up an Apache Flink cluster, download Flink CDC, create a YAML file to define your data sources and sinks, and then run the job. This benefits you by making it easier to manage and integrate your data efficiently across different databases.

https://github.com/apache/flink-cdc
#go #cicd #data_masking #data_security #database_access #dbeaver #devsecops #flyway #gitops #liquibase #mongodb #mysql #oracle #pam #postgresql #schema_migrations #security #snowflake #sql_client #sqlserver #tidb

Bytebase is a tool that helps manage databases more efficiently. It automates tasks like schema migrations and backups, making it easier to collaborate on database changes. Bytebase supports multiple databases and integrates well with CI/CD pipelines. It also provides features like role-based access control and data masking for better security. Using Bytebase simplifies database management, reduces errors, and saves time, making it beneficial for developers and database administrators.

https://github.com/bytebase/bytebase
#typescript #database #db #db_migration #editor #erd #mariadb #mssql #mysql #postgresql #react #react_flow #schema_migrations #sql #sqlite #typescript #visualization #xyflow

ChartDB is a powerful tool that helps you visualize and manage your database schema easily. It allows you to import your database structure with just one query and view it as a diagram. You can edit this diagram interactively, which makes it easier to understand and work with complex databases. ChartDB also uses AI to help you export your database schema to different systems, like from MySQL to PostgreSQL, making migrations simpler. This tool is open-source and available online or for local use, making it very useful for developers to design and collaborate on databases more efficiently.

https://github.com/chartdb/chartdb
#typescript #cli #clustering #concurrency #dependency_injection #effect #error_handling #javascript #observability #opentelemetry #platform #schema #typescript #workflows

Effect is a powerful TypeScript framework that helps you build reliable and complex applications by managing side effects like logging, network calls, and database operations in a safe and organized way. It uses a core `Effect` type to describe workflows that are lazy, composable, and type-safe, allowing you to handle errors and dependencies explicitly. The framework is modular, with many packages for AI, CLI tools, distributed computing, SQL databases, and more, making it flexible for various needs. Using Effect improves code quality, concurrency handling, and maintainability, helping you write robust TypeScript apps efficiently[1][2][4][5].

https://github.com/Effect-TS/effect