From 3346e8c0900590d2a4415dcee504afd3a5653b97 Mon Sep 17 00:00:00 2001 From: Stefan Schneider <28340802+stefanbschneider@users.noreply.github.com> Date: Sun, 30 Jul 2023 19:29:00 +0200 Subject: [PATCH 1/7] Update citation in readme Paper now accepted at TNSM 2023 --- README.md | 14 +++++++------- 1 file changed, 7 insertions(+), 7 deletions(-) diff --git a/README.md b/README.md index 2d1d07c..acac7cf 100644 --- a/README.md +++ b/README.md @@ -6,7 +6,8 @@ # DeepCoMP: Self-Learning Dynamic Multi-Cell Selection for Coordinated Multipoint (CoMP) -Deep reinforcement learning for dynamic multi-cell selection in CoMP scenarios. +Multi-Agent Deep Reinforcement Learning for Coordinated Multipoint in Mobile Networks + Three variants: DeepCoMP (central agent), DD-CoMP (distributed agents using central policy), D3-CoMP (distributed agents with separate policies). All three approaches self-learn and adapt to various scenarios in mobile networks without expert knowledge, human intervention, or detailed assumptions about the underlying system. Compared to other approaches, they are more flexible and achieve higher Quality of Experience. @@ -23,15 +24,14 @@ I also talked about DeepCoMP at the Ray Summit 2021 ([YouTube](https://youtu.be/ ## Citation -If you use this code, please cite our [paper (preprint; under review)](https://ris.uni-paderborn.de/download/33854/33855/preprint.pdf): +If you use this code, please cite our [paper (preprint; accepted at IEEE TNSM 2023)](https://ris.uni-paderborn.de/download/33854/33855): ``` -@article{schneider2021deepcomp, - title={DeepCoMP: Coordinated Multipoint Using Multi-Agent Deep Reinforcement Learning}, +@article{schneider2023deepcomp, + title={Multi-Agent Deep Reinforcement Learning for Coordinated Multipoint in Mobile Networks}, author={Schneider, Stefan and Karl, Holger and Khalili, Ramin and Hecker, Artur}, - journal={Under Review}, - year={2021}, - note={Open-source repository: \url{https://github.com/CN-UPB/DeepCoMP}} + journal={IEEE Transactions on Network and Service Management (TNSM)}, + year={2023}, } ``` From d15b8b3655374bef23201ca0e3111b02475d84cf Mon Sep 17 00:00:00 2001 From: Stefan Schneider <28340802+stefanbschneider@users.noreply.github.com> Date: Sun, 30 Jul 2023 19:31:22 +0200 Subject: [PATCH 2/7] link mobile-env in readme --- README.md | 2 ++ 1 file changed, 2 insertions(+) diff --git a/README.md b/README.md index acac7cf..807789a 100644 --- a/README.md +++ b/README.md @@ -16,6 +16,8 @@ For a high-level overview of DeepCoMP, please refer to my [blog post](https://st More details are available in our research paper presenting DeepCoMP ([preprint](https://ris.uni-paderborn.de/download/33854/33855/preprint.pdf)). I also talked about DeepCoMP at the Ray Summit 2021 ([YouTube](https://youtu.be/Qy4SzJKXlGE)). +The simulation environment used to train DeepCoMP is available separately as [mobile-env](https://github.com/stefanbschneider/mobile-env). +


Visualized cell selection policy of DeepCoMP after 2M training steps.
From c42931eb50d4bf305c3b324812a8d2dc4b528da0 Mon Sep 17 00:00:00 2001 From: Stefan Schneider <28340802+stefanbschneider@users.noreply.github.com> Date: Sun, 30 Jul 2023 19:35:43 +0200 Subject: [PATCH 3/7] delete citation.cff --- CITATION.cff | 17 ----------------- 1 file changed, 17 deletions(-) delete mode 100644 CITATION.cff diff --git a/CITATION.cff b/CITATION.cff deleted file mode 100644 index d728f5f..0000000 --- a/CITATION.cff +++ /dev/null @@ -1,17 +0,0 @@ -# YAML 1.2 ---- -authors: - - - affiliation: "Paderborn University" - family-names: Schneider - given-names: Stefan - orcid: "https://orcid.org/0000-0001-8210-4011" -cff-version: "1.1.0" -keywords: - - "reinforcement learning" - - "self learning" - - optimization -message: "If you use this software, please cite it using these metadata." -repository-code: "https://github.com/RealVNF/DeepCoMP" -title: "DeepCoMP: Self-Learning Dynamic Multi-Cell Selection for Coordinated Multipoint (CoMP)" -... \ No newline at end of file From 9dbf5a8ef6714368a317d92d0b7775960549fd2c Mon Sep 17 00:00:00 2001 From: Stefan Schneider <28340802+stefanbschneider@users.noreply.github.com> Date: Sun, 30 Jul 2023 19:37:31 +0200 Subject: [PATCH 4/7] fix python version in setup.py --- setup.py | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/setup.py b/setup.py index 4a2b0b3..2fe8a74 100644 --- a/setup.py +++ b/setup.py @@ -44,7 +44,7 @@ long_description_content_type='text/markdown', url='https://github.com/CN-UPB/DeepCoMP', packages=find_packages(), - python_requires=">=3.8.*", + python_requires=">=3.8.0", install_requires=requirements + eval_requirements, zip_safe=False, entry_points={ From 998abb16f4978957a9477666f1193e975f2db550 Mon Sep 17 00:00:00 2001 From: Stefan Schneider <28340802+stefanbschneider@users.noreply.github.com> Date: Sun, 30 Jul 2023 19:54:14 +0200 Subject: [PATCH 5/7] pin protobuf version --- setup.py | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-) diff --git a/setup.py b/setup.py index 2fe8a74..f512f0e 100644 --- a/setup.py +++ b/setup.py @@ -27,6 +27,8 @@ # extra dependencies for Ray RLlib # installing directly via ray[rllib] doesn't work with setup.py: https://github.com/ray-project/ray/issues/11274 'scipy==1.4.1', + # need to pin protobuf to avoid import errors: https://stackoverflow.com/q/71759248/2745116 + 'protobuf==4.23.4', # 'lz4', 'svgpath2mpl>=0.2.1', ] @@ -37,7 +39,7 @@ setup( name='deepcomp', - version='1.4.1', + version='1.4.2', author='Stefan Schneider', description="DeepCoMP: Self-Learning Dynamic Multi-Cell Selection for Coordinated Multipoint (CoMP)", long_description=long_description, From 01e250ea3408c0ed89b203cbffa7f5d973371964 Mon Sep 17 00:00:00 2001 From: Stefan Schneider <28340802+stefanbschneider@users.noreply.github.com> Date: Sun, 30 Jul 2023 20:02:12 +0200 Subject: [PATCH 6/7] pin protobuf to 3.20.3 --- setup.py | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/setup.py b/setup.py index f512f0e..37fb640 100644 --- a/setup.py +++ b/setup.py @@ -28,7 +28,7 @@ # installing directly via ray[rllib] doesn't work with setup.py: https://github.com/ray-project/ray/issues/11274 'scipy==1.4.1', # need to pin protobuf to avoid import errors: https://stackoverflow.com/q/71759248/2745116 - 'protobuf==4.23.4', + 'protobuf==3.20.3', # 'lz4', 'svgpath2mpl>=0.2.1', ] From 1bcbbc6ff3c5544f90cb4fab75c4de35df828d78 Mon Sep 17 00:00:00 2001 From: Stefan Schneider <28340802+stefanbschneider@users.noreply.github.com> Date: Sun, 30 Jul 2023 20:14:00 +0200 Subject: [PATCH 7/7] limit pydantic in setup.py --- setup.py | 2 ++ 1 file changed, 2 insertions(+) diff --git a/setup.py b/setup.py index 37fb640..30a906a 100644 --- a/setup.py +++ b/setup.py @@ -29,6 +29,8 @@ 'scipy==1.4.1', # need to pin protobuf to avoid import errors: https://stackoverflow.com/q/71759248/2745116 'protobuf==3.20.3', + # same for pydantic: https://github.com/aws/aws-sdk-pandas/issues/2379#issuecomment-1621178909 + 'pydantic<2.0.0', # 'lz4', 'svgpath2mpl>=0.2.1', ]