0.2.0

What's Changed

• Update version from 0.1.0 to 0.2.0-SNAPSHOT by @chia7712 in #1382
• [WEB] Revise balancer documentation by @garyparrot in #1383
• [WEB] Revise balancer documentation by @garyparrot in #1389
• Changing rate statistics by @chinghongfang in #1064
• [DISPATCHER] add more tests for StrictCostDispatcher by @chia7712 in #1390
• [WEB] Make costWeights a mandatory argument in POST /balancer by @garyparrot in #1392
• [COMMON] add cluster id to ClusterInfo by @chia7712 in #1398
• [COMMON] add AdminConfigs by @chia7712 in #1399
• [COMMON] add get/require method to Cache by @chia7712 in #1400
• [DISPATCHER] change Dispatcher from interface to abstract class by @chia7712 in #1401
• [DISPATCHER] create Admin for all dispatcher to fetch full cluster info by @chia7712 in #1402
• [DISPATCHER] Dispatcher#partition ought to take Replica instead of Re… by @chia7712 in #1404
• [COST] replace ReplicaInfo by Replica for HasBrokerCost by @chia7712 in #1405
• [COST] replace ReplicaInfo by Replica for HasPartitionCost by @chia7712 in #1406
• [COMMON] Replace ReplicaInfo by Replica for test scope by @chia7712 in #1408
• [ASSIGNOR] refactor Assignor by @chia7712 in #1410
• [DOC][PERF] Update performance tool doc by @chinghongfang in #1395
• [COMMON] remove ReplicaInfo and template from ClusterInfo by @chia7712 in #1411
• [DISPATCHER] reduce the overhead of collecting leader info by @chia7712 in #1413
• [COST][DISPATCHER] add NodeSizeCost to balance broker data size by @chia7712 in #1414
• [ETL]add checkpoint_path in start_stl.sh by @wycccccc in #1407
• [DISPATCHER] Maintenance of smooth weight round robin by @wycccccc in #1396
• [PERF] tracker 需要檢查 null consumer by @harryteng9527 in #1419
• [COMMON] add ClusterInfo#brokers by @chia7712 in #1417
• [DOC] add issue link of hardware to README by @chia7712 in #1421
• [TEST] fix the potential bug of broker leak by @chia7712 in #1422
• [CONNECTOR] Exporter flush file base on the time by @Haser0305 in #1370
• [TEST] add new class - service - to unify all kafka-related services by @chia7712 in #1425
• [TEST] remove RequireWorkerCluster and RequireSingleWorkerCluster by @chia7712 in #1426
• [TEST] remove RequireSingleBrokerCluster and RequireBrokerCluster by @chia7712 in #1428
• [BACKUP] Update the doc about Exporter by @Haser0305 in #1429
• [ASSIGNOR] Assignor handle admin by @harryteng9527 in #1415
• [COMMON] Json converter should support DataSize and Duration by @chia7712 in #1431
• Fix flaky ExporterTest#testFtpSinkTaskIntervalWith2Writers by @Haser0305 in #1434
• [GUI] add empty topic to health page by @chia7712 in #1435
• [COST] add cost function for record size by @chia7712 in #1436
• [COMMON] add assignor and state to ConsumerGroup by @chia7712 in #1441
• [COMMON] Implementation of MetricSeriesBuilder by @garyparrot in #1412
• [GUI] enbale to show assignor and state of consumer group by @chia7712 in #1442
• [PERF] Remove IOException from performance tool method signature by @garyparrot in #1445
• [COST] change ReplicaSizeCost to ReplicaLeaderSizeCost by @qoo332001 in #1333
• [COMMON] Implementation of Admin#declarePreferredDataFolders(Map) by @garyparrot in #1433
• [COMMON] add more topic checkers by @chia7712 in #1448
• [etl] Refactor etl build pattern api by @wycccccc in #1416
• Add health page by @chia7712 in #1450
• [COMMON] DataSize#toString should display double value by @chia7712 in #1452
• [DISPATCHER] tweak Dispatcher by @chia7712 in #1454
• [COMMON] remove unused variables by @chia7712 in #1455
• [COST] make sure all brokers have cost by @chia7712 in #1456
• [COMMON] update dependencies by @chia7712 in #1457
• fix HasMoveCost#of by @qoo332001 in #1449
• [COMMON] add ClusterBean#brokerIds and ClusterBean#brokerMetrics by @chia7712 in #1458
• [GUI] add network metrics to broker page by @chia7712 in #1459
• [DEP] Upgrade kafka from 3.3.1 to 3.3.2 by @chia7712 in #1460
• [TEST] Fix lost Service#close() call by @garyparrot in #1461
• [DOC] add 2022 party to README by @chia7712 in #1462
• [COST] Provide descriptive toString() implementation for weight composite function by @garyparrot in #1463
• [COST] Rewrite ReplicaNumberCost#clusterCost by @garyparrot in #1464
• [CONNECTOR] Add hdfs server, hdfsFileSystem and tests by @Haser0305 in #1447
• [COST] Provide Object#toString implementation for CostFunctions by @garyparrot in #1470
• [COST] Normalize the return value of ClusterCost from HasClusterCost#of by @garyparrot in #1465
• [COMMON] upgrade zookeeper from 3.8.0 to 3.8.1 by @chia7712 in #1472
• [PERF] Add publish e2e latency to report by @chinghongfang in #1474
• [COST] Provide descriptive Object#toString for ClusterCosts by @garyparrot in #1473
• [COST] merge MetricSensor and Fetcher by @chia7712 in #1477
• [COMMON] simplify MBeanClient by @chia7712 in #1479
• [PERF] make AbstractThread package-private by @chia7712 in #1483
• [DOC] add zk doc link to broker doc by @chia7712 in #1484
• [PERF] Binary search on zipfian value generating by @chinghongfang in #1486
• [CONNECTOR] Add script to start hadoop by @chaohengstudent in #1438
• [HDFS] simplify/fix start_hadoop.sh for OSX by @chia7712 in #1488
• [DOC] Make clear of gui jar file name in build_project by @chaohengstudent in #1489
• [WEB] Refactor BalancerHandler by @garyparrot in #1469
• [HDFS] Make rpc and http service use correct hostname by @chia7712 in #1490
• [HDFS] export JAVA_HOME for hadoop script by @chia7712 in #1492
• [CONNECTOR] Fix some issues in connector by @Haser0305 in #1487
• [COMMON] upgrade kafka from 3.3.2 to 3.4.0 by @chia7712 in #1495
• [METRICS] unify AppInfo by @chia7712 in #1497
• [GUI] add memory to BrokerNode by @chia7712 in #1498
• [COMMON] Implementation of ClusterInfo#topics by @garyparrot in #1494
• [COST] Fix NetworkCost raises an exception when some brokers have no replica by @garyparrot in #1499
• [BALANCER] add init cluster info to Balancer.Plan by @chia7712 in #1503
• [METRICS] Append worker metrics by @chaohengstudent in #1504
• [COST] Revise NetworkCost calculation formula by @garyparrot in #1507
• [COMMON] upgrade gradle from 7.6 to 8.0.1 by @chia7712 in #1510
• [JSON] remove debug code by @chia7712 in #1514
• [TEST] Fix flaky BalancerHandlerTest.testSubmitRebalancePlanThreadSafe by @chia7712 in #1513
• [COMMON] replace java.io.File by nio 2 by @Chi...

0.1.0 release

What's Changed

• add github action to run CI by @chia7712 in #2
• apply google java format by @chia7712 in #4
• Add my name to README in authors field by @chinghongfang in #3
• Adding Zheng-Xian Li to author section by @garyparrot in #5
• Add my name to README in authors field by @wycccccc in #6
• add scripts to set up env quickly by @chia7712 in #9
• enable gradle to show test event by @chia7712 in #12
• App should be the entry point and show the executable classes by @chia7712 in #13
• Add latency benchmark by @chia7712 in #16
• Enable to configure dependencies versions by @chia7712 in #17
• Generated data should include random timestamp by @chia7712 in #18
• authors update by @qoo332001 in #19
• Format generated data by @chia7712 in #20
• Let CloseableThread could execute once. by @chinghongfang in #22
• Throw exception while execute calls close by @chinghongfang in #23
• Directly test run() instead of using thread pool by @chinghongfang in #25
• Implemetation of MBean client by @garyparrot in #15
• Offset explorer - used to expose the earliest offset and latest offset for topics by @chia7712 in #29
• Enable to run kafka official tool by container by @chia7712 in #31
• Access scope of BeanQueryBuilder is too strict by @garyparrot in #33
• Enable to run kafka from source code by @chia7712 in #32
• Implementation of KafkaMetricClient (early version) by @garyparrot in #35
• Add outline of tools by @chia7712 in #36
• Use JCommander to analysis command line argument by @chinghongfang in #34
• Reconstruct argument parsing by @chinghongfang in #37
• Generate uber jar to be release file by @chia7712 in #40
• Offset tool should show replica details and group details by @chia7712 in #39
• Add doc for uber jar by @chia7712 in #42
• Use slf4j-nop to eliminate the slf4j warning by @chia7712 in #44
• ReplicaCollie - used to migrate replicas between brokers by @chia7712 in #43
• All tools should touch internal topics by @chia7712 in #45
• add metric client to README.md by @garyparrot in #48
• Make output of ReplicaCollie in-order by @chia7712 in #47
• Add --admin.props.file to OffsetExplorer and ReplicaCollie by @chia7712 in #49
• Align the argument naming by @chia7712 in #50
• Replace CloseableThread by ThreadPool by @chia7712 in #51
• remove redundant code App::toString by @garyparrot in #53
• List members of partitions by @chia7712 in #54
• Implementation of KafkaMetricClient (revised & new metrics) by @garyparrot in #55
• Unify all topic admin by @chia7712 in #56
• Add embedded kafka cluster to run test by @chia7712 in #57
• RequireBrokerCluster should be abstract by @chia7712 in #58
• TopicExploer should show replica folder by @chia7712 in #59
• Make KafkaMetricsTest fetch metrics from a real cluster. by @garyparrot in #61
• Rewrite ReplicaCollieTest by embedded server by @chia7712 in #62
• Rewrite TopicExplorerTest by embedded server by @chia7712 in #63
• Rewrite End2EndLatencyTest by embedded server by @chia7712 in #64
• Fix the link of Kafka offset explorer by @chia7712 in #67
• Implementation of KafkaMetrics (more metrics) by @garyparrot in #66
• Fix typo by @cxorm in #71
• Performance testing tool by @chinghongfang in #11
• Add RequireJmxServer infra by @chia7712 in #70
• Remove stale latency tool by @chia7712 in #72
• Remove tryQueryBean by @chia7712 in #73
• Update dependencies: kafka 2.8.0 -> 2.8.1; junit 5.7.2 -> 5.8.1 by @chia7712 in #74
• Don't wait consuemr to get assignment and make sure all required reco… by @chia7712 in #77
• Optimize the package name of metrics by @chia7712 in #80
• Add producer interface and consumer interface by @chia7712 in #81
• Enable to get replica size by @chia7712 in #83
• Erase the chance of concurrent read/write. by @chinghongfang in #82
• Refactor TopicAdmin by @chia7712 in #84
• add Header#of(String, byte[]) by @chia7712 in #85
• Implement poisson partitioner by @wycccccc in #27
• Integrate prometheus service to docker script by @chia7712 in #87
• Correct the average bytes by @chia7712 in #92
• Update README file by @chinghongfang in #93
• Enable to build kafak with sasl by @chia7712 in #95
• Fix zero consumer behaviour by @chinghongfang in #94
• Enable to create topic repeatedly by @chia7712 in #96
• Unify prop.file by @chia7712 in #97
• Fix flaky TopicAdminTest#testCreator by @chia7712 in #99
• Weight should be sum correct by @wycccccc in #101
• No consumer causes incorrect console output by @chia7712 in #100
• Add consumer assignment listener by @chinghongfang in #91
• Implementation of Metric Explorer by @garyparrot in #86
• Make sure test can run on windows by @chia7712 in #104
• Partition score by @qoo332001 in #65
• Add Zhi-Mao Teng to README.md in author section. by @harryteng9527 in #109
• 印出produce/consume時間 by @chinghongfang in #108
• The total bytes are not equal to sum of all producers output by @chia7712 in #110
• Add migrator interface by @chia7712 in #115
• Add TopicConfig interface by @chia7712 in #116
• Enable performance tool to apply compression by @chia7712 in #117
• Update dependencies by @chia7712 in #118
• Implement API for change log folder of partitions in TopicAdmin by @qoo332001 in #114
• Increase the JVM memory for testing by @chia7712 in #122
• Enable to mount host folders to broker container by @chia7712 in #125
• Enable to mount host folder to zookeeper service by @chia7712 in #126
• Implementation of replica syncing monitor by @garyparrot in #119
• Make MBeanClient be interface by @chia7712 in #131
• The embedded jmx server should use JNDI by @chia7712 in #132
• Fix duplicate partition caused by TopicAdmin#replicas by @chia7712 in #129
• Random record and producing duration setting by @chinghongfang in #106
• Implmenet thread-safe mbean collector by @chia7712 in #123
• Move ExeTime to separate file by @chia7712 in #134
• Enable to configure compact topic by @chia7712 in #139
• The address of jmx server should not use '127.0.0.1' by @chia7712 in https://github.com/skiptests...