diff --git a/README.md b/README.md
index ff51643e12..c01b53ab21 100644
--- a/README.md
+++ b/README.md
@@ -58,7 +58,7 @@ English | [简体中文](README_zh-CN.md)
 
 ## What's New
 
-v0.10.2 was released on 2023-12-26.
+v0.10.3 was released on 2024-1-24.
 
 Highlights:
 
@@ -70,7 +70,7 @@ Highlights:
 
 - Supports multiple visualization backends, including `NeptuneVisBackend`, `DVCLiveVisBackend` and `AimVisBackend`. Refer to [Visualization Backends](https://mmengine.readthedocs.io/en/latest/common_usage/visualize_training_log.html) for more details.
 
-Read [Changelog](./docs/en/notes/changelog.md#v0102-26122023) for more details.
+Read [Changelog](./docs/en/notes/changelog.md#v0103-2412024) for more details.
 
 ## Table of Contents
 
diff --git a/README_zh-CN.md b/README_zh-CN.md
index 0fd5d272fd..3400ca35e5 100644
--- a/README_zh-CN.md
+++ b/README_zh-CN.md
@@ -58,7 +58,7 @@
 
 ## 最近进展
 
-最新版本 v0.10.2 在 2023.12.26 发布。
+最新版本 v0.10.3 在 2024.1.24 发布。
 
 亮点：
 
@@ -70,7 +70,7 @@
 
 - 支持多种可视化后端，包括`NeptuneVisBackend`、`DVCLiveVisBackend` 和 `AimVisBackend`。可阅读[可视化后端](https://mmengine.readthedocs.io/zh_CN/latest/common_usage/visualize_training_log.html)了解用法。
 
-如果想了解更多版本更新细节和历史信息，请阅读[更新日志](./docs/en/notes/changelog.md#v0102-26122023)
+如果想了解更多版本更新细节和历史信息，请阅读[更新日志](./docs/en/notes/changelog.md#v0103-2412024)。
 
 ## 目录
 
diff --git a/docs/en/notes/changelog.md b/docs/en/notes/changelog.md
index 7433be503a..30f9b0e1e6 100644
--- a/docs/en/notes/changelog.md
+++ b/docs/en/notes/changelog.md
@@ -1,5 +1,24 @@
 # Changelog of v0.x
 
+## v0.10.3 (24/1/2024)
+
+### New Features & Enhancements
+
+- Add the support for musa device support by [@hanhaowen-mt](https://github.com/hanhaowen-mt) in https://github.com/open-mmlab/mmengine/pull/1453
+- Support `save_optimizer=False` for DeepSpeed by [@LZHgrla](https://github.com/LZHgrla) in https://github.com/open-mmlab/mmengine/pull/1474
+- Update visualizer.py by [@Anm-pinellia](https://github.com/Anm-pinellia) in https://github.com/open-mmlab/mmengine/pull/1476
+
+### Bug Fixes
+
+- Fix `Config.to_dict` by [@HAOCHENYE](https://github.com/HAOCHENYE) in https://github.com/open-mmlab/mmengine/pull/1465
+- Fix the resume of iteration by [@LZHgrla](https://github.com/LZHgrla) in https://github.com/open-mmlab/mmengine/pull/1471
+- Fix `dist.collect_results` to keep all ranks' elements by [@LZHgrla](https://github.com/LZHgrla) in https://github.com/open-mmlab/mmengine/pull/1469
+
+### Docs
+
+- Add the usage of ProfilerHook by [@zhouzaida](https://github.com/zhouzaida) in https://github.com/open-mmlab/mmengine/pull/1466
+- Fix the nnodes in the doc of ddp training by [@XiwuChen](https://github.com/XiwuChen) in https://github.com/open-mmlab/mmengine/pull/1462
+
 ## v0.10.2 (26/12/2023)
 
 ### New Features & Enhancements
diff --git a/mmengine/version.py b/mmengine/version.py
index d36dfb8380..cfc82fdadc 100644
--- a/mmengine/version.py
+++ b/mmengine/version.py
@@ -1,6 +1,6 @@
 # Copyright (c) OpenMMLab. All rights reserved.
 
-__version__ = '0.10.2'
+__version__ = '0.10.3'
 
 
 def parse_version_info(version_str):