{"payload":{"feedbackUrl":"https://github.com/orgs/community/discussions/53140","repo":{"id":146944069,"defaultBranch":"3.0-li","name":"kafka","ownerLogin":"linkedin","currentUserCanPush":false,"isFork":true,"isEmpty":false,"createdAt":"2018-08-31T21:32:03.000Z","ownerAvatar":"https://avatars.githubusercontent.com/u/357098?v=4","public":true,"private":false,"isOrgOwned":true},"refInfo":{"name":"","listCacheKey":"v0:1725494242.0","currentOid":""},"activityList":{"items":[{"before":"e5f46af0f523f4a72d4591708b370e51c92d4963","after":null,"ref":"refs/heads/20240904_add_min_rollout_config","pushedAt":"2024-09-04T20:16:26.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"CCisGG","name":"Hao Geng","path":"/CCisGG","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/38366317?s=80&v=4"}},{"before":"cfa6f94d4c89d673a7e08ab811d2b55f38b91ade","after":"e6b20e651b125b4b9ab994d64249d0eb2ca74ccd","ref":"refs/heads/3.0-li","pushedAt":"2024-09-04T20:16:24.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"CCisGG","name":"Hao Geng","path":"/CCisGG","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/38366317?s=80&v=4"},"commit":{"message":"Add LiMinSegmentRollMs to prevent log roll to be so fast (#521)\n\nToday, the log roll time can be very short if maxCompactionLagMs and logRollTimeJitterMillis are not set properly. E.g. if logRollTimeJitterMillis is larger than maxCompactionLagMs, the log roll time can be as short as 0 millisecond so that new segments are rolling out on every new message. This will cause too many open file handles error and crash the process.\r\n\r\nThis fix adds a min interval between segments rollout, and the interval will be able to configured at server side via config LiMinSegmentRollMs. In this PR, we set the default value to be 15 minutes, so that no new segments can be rollout within 15 minutes.","shortMessageHtmlLink":"Add LiMinSegmentRollMs to prevent log roll to be so fast (#521)"}},{"before":"1515b4612c2cdf6f2dd717a81d04ca135e129825","after":"e5f46af0f523f4a72d4591708b370e51c92d4963","ref":"refs/heads/20240904_add_min_rollout_config","pushedAt":"2024-09-04T19:57:42.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"CCisGG","name":"Hao Geng","path":"/CCisGG","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/38366317?s=80&v=4"},"commit":{"message":"Address Greg's comment and fix/add unit test","shortMessageHtmlLink":"Address Greg's comment and fix/add unit test"}},{"before":"ea2ccfe4fc33c0919759688db07e84999ee7c295","after":"1515b4612c2cdf6f2dd717a81d04ca135e129825","ref":"refs/heads/20240904_add_min_rollout_config","pushedAt":"2024-09-04T18:11:09.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"CCisGG","name":"Hao Geng","path":"/CCisGG","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/38366317?s=80&v=4"},"commit":{"message":"Remove blank line","shortMessageHtmlLink":"Remove blank line"}},{"before":null,"after":"ea2ccfe4fc33c0919759688db07e84999ee7c295","ref":"refs/heads/20240904_add_min_rollout_config","pushedAt":"2024-09-04T18:09:12.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"CCisGG","name":"Hao Geng","path":"/CCisGG","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/38366317?s=80&v=4"},"commit":{"message":"Add LiMinSegmentRollMs to prevent log roll to be so fast","shortMessageHtmlLink":"Add LiMinSegmentRollMs to prevent log roll to be so fast"}},{"before":"431c0c01be0a11c21afbb7857c0e4be3177d7a25","after":null,"ref":"refs/heads/user/rjobse/newNodeSize","pushedAt":"2024-09-03T16:22:16.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"JobseRyan","name":"Ryan Jobse","path":"/JobseRyan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/104791612?s=80&v=4"}},{"before":"05c9ff8917e2661ca0ff8653a8c51c2f719373cf","after":"cfa6f94d4c89d673a7e08ab811d2b55f38b91ade","ref":"refs/heads/3.0-li","pushedAt":"2024-09-03T16:22:14.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"JobseRyan","name":"Ryan Jobse","path":"/JobseRyan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/104791612?s=80&v=4"},"commit":{"message":"checking newNode size to make sure its not 0 (#520)\n\n* checking newNode size to make sure its not 0","shortMessageHtmlLink":"checking newNode size to make sure its not 0 (#520)"}},{"before":"77b3211ce98b4e34a056cf5bb04b81a7c619c25a","after":"431c0c01be0a11c21afbb7857c0e4be3177d7a25","ref":"refs/heads/user/rjobse/newNodeSize","pushedAt":"2024-08-28T20:21:31.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"JobseRyan","name":"Ryan Jobse","path":"/JobseRyan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/104791612?s=80&v=4"},"commit":{"message":"adding exception import","shortMessageHtmlLink":"adding exception import"}},{"before":"c3d21a47e1af7e9160116cb64272519cb9a2c871","after":"77b3211ce98b4e34a056cf5bb04b81a7c619c25a","ref":"refs/heads/user/rjobse/newNodeSize","pushedAt":"2024-08-28T20:18:40.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"JobseRyan","name":"Ryan Jobse","path":"/JobseRyan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/104791612?s=80&v=4"},"commit":{"message":"fixing ut","shortMessageHtmlLink":"fixing ut"}},{"before":"c2d281a5f655753084f01ea4216973707ebddcc0","after":"c3d21a47e1af7e9160116cb64272519cb9a2c871","ref":"refs/heads/user/rjobse/newNodeSize","pushedAt":"2024-08-28T18:22:09.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"JobseRyan","name":"Ryan Jobse","path":"/JobseRyan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/104791612?s=80&v=4"},"commit":{"message":"fixing ut","shortMessageHtmlLink":"fixing ut"}},{"before":"bb224b3d76ac0a59ecaca5ba7fc15fa7afc3d8cf","after":"c2d281a5f655753084f01ea4216973707ebddcc0","ref":"refs/heads/user/rjobse/newNodeSize","pushedAt":"2024-08-28T18:09:48.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"JobseRyan","name":"Ryan Jobse","path":"/JobseRyan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/104791612?s=80&v=4"},"commit":{"message":"adding UT for no newNodes","shortMessageHtmlLink":"adding UT for no newNodes"}},{"before":null,"after":"bb224b3d76ac0a59ecaca5ba7fc15fa7afc3d8cf","ref":"refs/heads/user/rjobse/newNodeSize","pushedAt":"2024-08-28T17:58:42.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"JobseRyan","name":"Ryan Jobse","path":"/JobseRyan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/104791612?s=80&v=4"},"commit":{"message":"checking newNode size to make sure its not 0","shortMessageHtmlLink":"checking newNode size to make sure its not 0"}},{"before":null,"after":"0cef3ed9826f42ed2cce7193224e4255c9fc0ea4","ref":"refs/heads/20240828_tmp_fix","pushedAt":"2024-08-28T14:59:50.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"CCisGG","name":"Hao Geng","path":"/CCisGG","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/38366317?s=80&v=4"},"commit":{"message":"Add max request count limit for LiCombinedControlRequest","shortMessageHtmlLink":"Add max request count limit for LiCombinedControlRequest"}},{"before":null,"after":"871278167ec38b54e2b9ca3bebbde1c8a967a1be","ref":"refs/heads/20240828_tmp_fix_for_reduce_lccr_size","pushedAt":"2024-08-28T14:57:29.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"CCisGG","name":"Hao Geng","path":"/CCisGG","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/38366317?s=80&v=4"},"commit":{"message":"Add max request count limit for LiCombinedControlRequest","shortMessageHtmlLink":"Add max request count limit for LiCombinedControlRequest"}},{"before":"21160298601f4d907cec97278e4e0f7f72e9420d","after":null,"ref":"refs/heads/user/rjobse/addSizeCheckToNewNodes","pushedAt":"2024-08-27T21:13:41.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"JobseRyan","name":"Ryan Jobse","path":"/JobseRyan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/104791612?s=80&v=4"}},{"before":null,"after":"21160298601f4d907cec97278e4e0f7f72e9420d","ref":"refs/heads/user/rjobse/addSizeCheckToNewNodes","pushedAt":"2024-08-27T21:12:38.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"JobseRyan","name":"Ryan Jobse","path":"/JobseRyan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/104791612?s=80&v=4"},"commit":{"message":"adding a size check to newNodes","shortMessageHtmlLink":"adding a size check to newNodes"}},{"before":"702aecd7d391e56fadc9755da457078b2dca348d","after":null,"ref":"refs/heads/user/rjobse/addNewNodeSizeCheck","pushedAt":"2024-08-27T21:11:17.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"JobseRyan","name":"Ryan Jobse","path":"/JobseRyan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/104791612?s=80&v=4"}},{"before":"05c9ff8917e2661ca0ff8653a8c51c2f719373cf","after":"702aecd7d391e56fadc9755da457078b2dca348d","ref":"refs/heads/user/rjobse/addNewNodeSizeCheck","pushedAt":"2024-08-27T21:08:00.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"JobseRyan","name":"Ryan Jobse","path":"/JobseRyan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/104791612?s=80&v=4"},"commit":{"message":"adding a size check to newNodes","shortMessageHtmlLink":"adding a size check to newNodes"}},{"before":null,"after":"05c9ff8917e2661ca0ff8653a8c51c2f719373cf","ref":"refs/heads/user/rjobse/addNewNodeSizeCheck","pushedAt":"2024-08-27T21:06:26.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"JobseRyan","name":"Ryan Jobse","path":"/JobseRyan","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/104791612?s=80&v=4"},"commit":{"message":"Revert \"[LI-HOTFIX] Return valid data during throttling (#514)\" (#515)\n\nThis reverts commit d4f6f914f4bb711d7af502ed934ca31fe9688a68.\r\n\r\nFor the \"consumer get stuck during throttling\" issue, we realized there is a safer solution than the above commit. The alternative solution is to increase the maxThrottleTime by increase the quota window size, which should effectively reduce the overall throughput. We will go with that path first. If the issue is still not mitigated, we can fallback to this solution and re-apply this patch.","shortMessageHtmlLink":"Revert \"[LI-HOTFIX] Return valid data during throttling (#514)\" (#515)"}},{"before":"05433df1f9116f8a3da2729acb44e2d612baff4f","after":null,"ref":"refs/heads/yy/fix-throttle-msg","pushedAt":"2024-07-18T16:49:54.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"Yellow-Rice","name":"Yuhao Yang","path":"/Yellow-Rice","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/4949964?s=80&v=4"}},{"before":"2720a23a262fd2ff95fdc561a5790d7c25de1b86","after":"5f9845f76ae5163f0ef2755db5f3e58d5d419021","ref":"refs/heads/2.4-li","pushedAt":"2024-07-18T16:49:52.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"Yellow-Rice","name":"Yuhao Yang","path":"/Yellow-Rice","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/4949964?s=80&v=4"},"commit":{"message":"KAFKA-9364: Fix misleading consumer logs on throttling (#7894) (#517)\n\nWhen the consumer's fetch request is throttled by the KIP-219 mechanism,\r\nit receives an empty fetch response. The consumer should not log this\r\nas an error.\r\n\r\nReviewers: Jason Gustafson \r\n\r\nCo-authored-by: Colin Patrick McCabe ","shortMessageHtmlLink":"KAFKA-9364: Fix misleading consumer logs on throttling (apache#7894) (#…"}},{"before":null,"after":"05433df1f9116f8a3da2729acb44e2d612baff4f","ref":"refs/heads/yy/fix-throttle-msg","pushedAt":"2024-07-17T22:12:51.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"Yellow-Rice","name":"Yuhao Yang","path":"/Yellow-Rice","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/4949964?s=80&v=4"},"commit":{"message":"KAFKA-9364: Fix misleading consumer logs on throttling (#7894)\n\nWhen the consumer's fetch request is throttled by the KIP-219 mechanism,\r\nit receives an empty fetch response. The consumer should not log this\r\nas an error.\r\n\r\nReviewers: Jason Gustafson ","shortMessageHtmlLink":"KAFKA-9364: Fix misleading consumer logs on throttling (apache#7894)"}},{"before":"e44f867821f3ab65c424ce00ddd81e92838cef5f","after":null,"ref":"refs/heads/fix_ClientUtilsTest","pushedAt":"2024-07-17T21:54:59.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"Yellow-Rice","name":"Yuhao Yang","path":"/Yellow-Rice","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/4949964?s=80&v=4"}},{"before":"1c0e2f9215a8579f919cc1f9c352014ed9783f4c","after":"2720a23a262fd2ff95fdc561a5790d7c25de1b86","ref":"refs/heads/2.4-li","pushedAt":"2024-07-17T21:54:57.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"Yellow-Rice","name":"Yuhao Yang","path":"/Yellow-Rice","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/4949964?s=80&v=4"},"commit":{"message":"[LI-CHERRY-PICK] MINOR: example.com moved (#15758) (#512) (#516)\n\nReviewers: Chia-Ping Tsai , Kuan-Po (Cooper) Tseng , Viktor Somogyi-Vass \r\n\r\nCo-authored-by: Huilin Shi \r\nCo-authored-by: Andras Katona <41361962+akatona84@users.noreply.github.com>","shortMessageHtmlLink":"[LI-CHERRY-PICK] MINOR: example.com moved (apache#15758) (#512) (#516)"}},{"before":null,"after":"e44f867821f3ab65c424ce00ddd81e92838cef5f","ref":"refs/heads/fix_ClientUtilsTest","pushedAt":"2024-07-17T20:31:35.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"Yellow-Rice","name":"Yuhao Yang","path":"/Yellow-Rice","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/4949964?s=80&v=4"},"commit":{"message":"[LI-CHERRY-PICK] MINOR: example.com moved (#15758) (#512)\n\nReviewers: Chia-Ping Tsai , Kuan-Po (Cooper) Tseng , Viktor Somogyi-Vass \n\nCo-authored-by: Andras Katona <41361962+akatona84@users.noreply.github.com>","shortMessageHtmlLink":"[LI-CHERRY-PICK] MINOR: example.com moved (apache#15758) (#512)"}},{"before":"fadb79f8f68bd41afde1a705ff240b099c4395a9","after":null,"ref":"refs/heads/20240611_revert","pushedAt":"2024-06-11T20:25:38.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"CCisGG","name":"Hao Geng","path":"/CCisGG","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/38366317?s=80&v=4"}},{"before":"d4f6f914f4bb711d7af502ed934ca31fe9688a68","after":"05c9ff8917e2661ca0ff8653a8c51c2f719373cf","ref":"refs/heads/3.0-li","pushedAt":"2024-06-11T20:25:37.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"CCisGG","name":"Hao Geng","path":"/CCisGG","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/38366317?s=80&v=4"},"commit":{"message":"Revert \"[LI-HOTFIX] Return valid data during throttling (#514)\" (#515)\n\nThis reverts commit d4f6f914f4bb711d7af502ed934ca31fe9688a68.\r\n\r\nFor the \"consumer get stuck during throttling\" issue, we realized there is a safer solution than the above commit. The alternative solution is to increase the maxThrottleTime by increase the quota window size, which should effectively reduce the overall throughput. We will go with that path first. If the issue is still not mitigated, we can fallback to this solution and re-apply this patch.","shortMessageHtmlLink":"Revert \"[LI-HOTFIX] Return valid data during throttling (#514)\" (#515)"}},{"before":null,"after":"fadb79f8f68bd41afde1a705ff240b099c4395a9","ref":"refs/heads/20240611_revert","pushedAt":"2024-06-11T19:36:28.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"CCisGG","name":"Hao Geng","path":"/CCisGG","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/38366317?s=80&v=4"},"commit":{"message":"Revert \"[LI-HOTFIX] Return valid data during throttling (#514)\"\n\nThis reverts commit d4f6f914f4bb711d7af502ed934ca31fe9688a68.","shortMessageHtmlLink":"Revert \"[LI-HOTFIX] Return valid data during throttling (#514)\""}},{"before":"968950da0118f79781ce546a90d2a322d142455b","after":null,"ref":"refs/heads/20240605_fill_data_when_throttling","pushedAt":"2024-06-06T21:38:34.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"CCisGG","name":"Hao Geng","path":"/CCisGG","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/38366317?s=80&v=4"}},{"before":"42e6fae5a14c00d2947e772212a0dd9c189987f5","after":"d4f6f914f4bb711d7af502ed934ca31fe9688a68","ref":"refs/heads/3.0-li","pushedAt":"2024-06-06T21:38:33.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"CCisGG","name":"Hao Geng","path":"/CCisGG","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/38366317?s=80&v=4"},"commit":{"message":"[LI-HOTFIX] Return valid data during throttling (#514)\n\nIn KIP-219, people decided to changed the throttling behavior from \"wait for throttleTimeMs before sending back response\" to \"return immediately with empty response and mute the channel by throttleTimeMs\". While it is reasonable in terms of it strictly limit the Fetch Bytes Rate to below the quota value, it introduces a new problem that the request already takes the broker system resource but the consumer does not get any useful data. As a result, the broker could be busy with handling throttled requests and keep throttle incoming request, while none of the request has data and consumers get stuck.\r\n\r\nTo mitigate it, we propose to actually return the data in the throttled response. By doing it, the consumer can still slowly proceed even though all the requests are throttled.","shortMessageHtmlLink":"[LI-HOTFIX] Return valid data during throttling (#514)"}}],"hasNextPage":true,"hasPreviousPage":false,"activityType":"all","actor":null,"timePeriod":"all","sort":"DESC","perPage":30,"cursor":"djE6ks8AAAAErSC2GQA","startCursor":null,"endCursor":null}},"title":"Activity · linkedin/kafka"}