2021.10 - Royal Kill

[hugsy]

Changelog: 2021.10 - Royal Kill

Highlights of Royal Kill

• 93 commits, 5 Issues & 25 PRs closed
• Massive background re-work by @theguy147 , which includes (but not limited):
  • Better and more CI tests
  • Code coverage
  • Documentation refreshing
• The elf-info command was entirely rewrote (@Kileak)
  
• GEF now supports custom context panes (thanks to @mahaloz ) which allow to create custom (external) commands, and have them displayed as part of the break context
  
• Heap stuff: heap chunks can now also display chunks in any/all arenas, fixed alignment issues (@theguy147 )
  
• Fixed many bugs in unicorn-emulate and capstone-disassemble commands (@theguy147 ) - with better CI to detect failures faster
  
• Thanks to donations the CI has been massively improved for picking bugs quickly and in a cross-platform manner
  • CI - runner AARCH64
    
  • CI - runner ARMv7
    
• And a lot more...

Contributors

Author	Number of commits
theguy	37
hugsy	31
Grazfather	7
Zion	5
Ammar Faizi	3
Kileak	2
CptGibbon	1
irontigran	1
plop	1
RafaelLeeImg	1
Simon Segars	1

Closed Issues

• 5 issues closed ( 735 • 730 • 729 • 726 • 724 )

Closed Pull Requests

• 25 PRs closed ( 744 • 743 • 742 • 741 • 740 • 739 • 738 • 737 • 736 • 733 • 732 • 731 • 728 • 727 • 725 • 723 • 722 • 721 • 720 • 718 • 717 • 716 • 715 • 714 • 713 )

Commit details

93 commits since 2021.07

Commit log

• 2021-07-05 65a8ccf • hugsy • improved the new-release script, now in python, and polls some data directly from github
• 2021-07-05 f1d3e38 • hugsy • removed old release script
• 2021-07-06 5eb3b24 • Ammar Faizi • x86-64: Preserve RCX and R11 when calling mprotect_asm (syscall)
• 2021-07-07 a2b93a7 • Ammar Faizi • search-pattern: Don't stop searching when read_memory fails
• 2021-07-07 593b5d3 • Ammar Faizi • test set-permission: Improve the test case
• 2021-07-17 1e52006 • hugsy • Multiple fixes: - fixed syntax error in discord-notify - updated new-release.py to include stats of code addition/removal - added credit for gef logo in docs/index.md
• 2021-07-22 e9614ab • theguy • fix python version in unicorn-emulate
• 2021-07-22 590f2b9 • theguy • remove pip2 instructions from documentation
• 2021-07-22 57d8450 • theguy147 • dereference: add option to use reference address for offset calculation (deref: added option to use reference address for offset calculation #676)
• 2021-07-23 a5ddc67 • theguy • use PYTHONBIN across the source
• 2021-07-23 c8dca47 • hugsy • Merge pull request fix python executable version in unicorn-emulate #678 from theguy147/py3
• 2021-07-23 7e3bb6f • hugsy • marked ida-interact as obsolete, will be replaced soon
• 2021-07-26 0b6d816 • Grazfather • Make docs install instructions match readme
• 2021-07-26 296f9f2 • hugsy • Merge branch 'dev' of github.com:hugsy/gef into dev
• 2021-07-26 f5e8ceb • hugsy • [docs] Fixing Install script seems to need bash #680 : auto install scripts don't use sh anymore but bash
• 2021-07-26 48a9fd7 • Grazfather • Update config & index docs
• 2021-07-28 880f8b8 • theguy147 • Fix memory watch to use new argparse syntax of hexdump cmd (Fixed: memory watch uses new argparse syntax of hexdump cmd #684)
• 2021-07-28 8cb298b • theguy147 • Add git blob hash to version cmd (Add git blob hash to version cmd #683)
• 2021-07-28 77889d8 • theguy147 • fix typo in version docs (Fix typo #688)
• 2021-07-31 29cc794 • theguy • memory watch unit tests for checking memory content
• 2021-07-31 a8addf5 • theguy • fix size argument for hexdump cmd
• 2021-07-31 44b00a8 • theguy • Fixed typo in pull request template
• 2021-07-31 dddb7bf • theguy • Fix heap commands when the glibc arena has not set all expected members
• 2021-07-31 f25ba5f • Grazfather • Fix syntax for ASLR
• 2021-07-31 90c4634 • Grazfather • Fix docs for patch (aliases in gef-extras)
• 2021-07-31 c21fe01 • Grazfather • Fix docs for 'memory'
• 2021-07-31 04408d2 • Grazfather • nop: Fix default arg and docs
• 2021-08-03 11bd6a7 • theguy • Mimic glibc's MALLOC_ALIGNMENT for heap chunks
• 2021-08-03 477086e • theguy • Fix usage of wrong var in output
• 2021-08-03 c590f71 • theguy • Allow unaligned heap chunks as option
• 2021-08-04 2a47ff8 • theguy • Add optional flags to disable auto-alignment of heap chunks
• 2021-08-04 d5e958a • theguy • Update heap cmd docs
• 2021-08-03 2517616 • hugsy • Update discord-notify.yml
• 2021-08-06 ec114a6 • hugsy • [doc] Updated print-format.md
• 2021-08-07 b33316a • theguy • Change 'LOCATION' to 'address'
• 2021-08-10 8ed91f6 • hugsy • Merge pull request nop: Fix default arg and docs #696 from hugsy/fix_nop
• 2021-08-10 ea5ecff • hugsy • Update nop.md
• 2021-08-10 0b7c616 • hugsy • Merge pull request Mimic glibc's MALLOC_ALIGNMENT for heap chunks #697 from theguy147/heap-malloc-align
• 2021-08-11 05520e2 • Simon Segars • gef.sh: check if cURL or wget exist on the system
• 2021-08-15 5a9b2a2 • theguy147 • Fix gef-remote: retrieve pid of inferior process after having connected to target (Fix gef-remote: retrieve pid of inferior process after having connected to target #686)
• 2021-08-21 e152a34 • hugsy • Merge pull request gef.sh is now works on Ubuntu 21.04 (Hirsute Hippo) #699 #700 from BadSugar/ubuntu_fix_gef_sh
• 2021-08-21 1ca68c4 • hugsy • Unittest: - added test for gef_get_auxiliary_values - added test for gef_convenience - fixed test for memory_watch
• 2021-08-21 4554aa0 • hugsy • Added a new decorator only_if_current_arch_in and its doc
• 2021-08-21 76c060f • hugsy • Added unittest for parse_address
• 2021-08-21 2fb1b10 • hugsy • Update run-tests.yml
• 2021-08-21 90d2c8c • hugsy • Fixed test of test_cmd_memory_watch: no need for scanf, which makes testing more hazardous
• 2021-08-23 dcfa6f2 • theguy147 • Fix capstone-disassemble command and documentation (Fix capstone-disassemble command and documentation #695)
• 2021-08-23 6300e75 • theguy147 • Fix assemble command including docs and tests (Fix assemble command incl docs and tests #694)
• 2021-08-24 5e5c638 • theguy147 • Update break commands (Update break commands #702)
• 2021-08-25 4f9bd61 • hugsy • [ci] added ubuntu-18.04 to the list of CI targets
• 2021-08-25 b56e8cc • hugsy • [ci] added ubuntu-18.04 to the list of CI targets (duh)
• 2021-08-25 5beef62 • hugsy • [ci] in test bins, replaced int3 with __builtin_trap()
• 2021-08-25 c942736 • hugsy • followup on 4f9bd61
• 2021-08-25 00bb124 • hugsy • [ci] added decorators to include/exclude test for specific architecture(s)
• 2021-09-02 169e6e6 • plop • fix typo in search-pattern help (fix typo in search-pattern help #705)
• 2021-09-04 c4a4f58 • theguy147 • Fix name-break address parsing (Fix name-break address parsing (#707) #708)
• 2021-09-05 8c5abfc • Kileak • Fix namebreak and add additional unit tests (Fix namebreak and add additional unit tests #710)
• 2021-09-05 139830f • hugsy • 📕 adding new sponsors on readme
• 2021-09-05 0bc68bb • hugsy • 📕 fixed xinfo screenshot
• 2021-09-07 1f208cc • theguy147 • Update docs for several commands (Update docs for several commands #703)
• 2021-09-07 f02e9ae • theguy147 • Update and fix heap command (Update and fix heap command #701)
• 2021-09-07 f1ffad0 • theguy147 • Add test for gef-remote cmd (Add test for gef-remote cmd #712)
• 2021-09-08 620ca60 • CptGibbon • Correct have_fastchunks arena adjustment (Correct have_fastchunks arena adjustment #704)
• 2021-09-08 3bc42ef • theguy147 • Fix unicorn-emulate cmd (Fix unicorn-emulate cmd #713)
• 2021-09-11 3fc237c • theguy147 • Fix 'heap chunks' command for non-main arenas (heap chunks doesn't list chunks in a non-main arena #706) (Fix 'heap chunks' command for non-main arenas (#706) #709)
• 2021-09-14 90ffa6b • hugsy • Use pytest on top of unittest to allow multi-proc execution (Use pytest on top of unittest to allow multi-proc execution #714)
• 2021-09-15 44c12c6 • RafaelLeeImg • Fix error where breakpoint.location is None (Fix context failed to execute because breakpoint.location is None #715)
• 2021-09-19 f37d0ff • Kileak • Backport Elf / ElfInfoCommand updates (Backport Elf / ElfInfoCommand updates #717)
• 2021-09-20 1c80677 • theguy147 • Fix error on help (Fix error message on help #721)
• 2021-09-20 11a68a2 • theguy147 • Fix heap chunks cmd for multiple heaps per arena (Fix heap chunks cmd for multiple heaps per arena #716)
• 2021-09-21 915ff91 • hugsy • Configuration for the stale bot (Configuration for the stale bot  #718)
• 2021-09-21 860facf • irontigran • Add test for printing chunks with multiple heaps (Add test for printing chunks with multiple heaps #711)
• 2021-09-21 f5df117 • theguy147 • Add feature to print heap chunks of all arenas (Add feature to print heap chunks of all arenas #722)
• 2021-09-21 1df157e • theguy147 • refactor: use parse_address whenever appropriate (refactor: use parse_address whenever appropriate #723)
• 2021-09-24 143e60a • hugsy • Adding unit tests for non-x86 architectures (Adding unit tests for non-x86 architectures #720)
• 2021-09-25 6400ef7 • Grazfather • CI: Lint: Add more linters to test files (CI: Lint: Add more linters to test files #725)
• 2021-09-26 55f9090 • hugsy • [ci] adjusted heap-multiple-heaps to use the universal DebugBreak so non x86 test can successfully be triggered
• 2021-09-27 3b0d9da • Zion • Support for custom contexts in ContextCommand (Support for custom contexts in ContextCommand #727)
• 2021-09-29 a4a9033 • hugsy • [CI] Use Actions to check URL links in the documentation ([CI] Use Actions to check URL links in the documentation #731)
• 2021-09-29 5baa128 • Zion • Allow empty context titles (Allow empty context titles #732)
• 2021-09-30 970a6d3 • theguy147 • fix: cleanly close opened files (fix: cleanly close opened files #737)
• 2021-09-30 5ecaadb • theguy147 • Review (Review #733)
• 2021-10-02 fac4e7d • theguy147 • fix: DeprecationWarning for unicode-escape decoding (fix: DeprecationWarning for unicode-escape decoding #736)
• 2021-10-08 467273f • theguy147 • fix: create tempdir before first usage (fix: create tempdir before first usage #740)
• 2021-10-08 078ce33 • theguy147 • feat: allow tests to be run in other places than /tmp (feat: allow tests to be run in other places than /tmp #739)
• 2021-10-10 ed413d1 • theguy147 • feat: measure coverage (feat: measure coverage #738)
• 2021-10-13 8719457 • Zion • Fix a max() call on None in print_guessed_arguments (fix a max() call on None in print_guessed_arguments #742)
• 2021-10-13 48ed480 • Zion • Resolve Context Trace Symbols (Resolve Context Trace Symbols #743)
• 2021-10-13 5c2fe28 • Zion • add thread symbol resolving like traces (Resolve Context Thread Symbols #744)
• 2021-10-14 2becf7b • hugsy • Update docs/requirements.txt
• 2021-10-16 63ffc67 • hugsy • Fixed a few bugs and added minor improvements to scripts/new-release.py
• 2021-10-16 8074f88 • hugsy • Merge fix
• 2021-10-16 278e84d • hugsy • Merge branch 'master' into dev

File diff

 .ci/mlc_config.json                   |    3 +
 .github/PULL_REQUEST_TEMPLATE.md      |    2 +-
 .github/stale.yml                     |   25 ++
 .github/workflows/discord-notify.yml  |   10 +-
 .github/workflows/docs-link-check.yml |   16 ++
 .github/workflows/run-tests.yml       |   23 +-
 .gitignore                            |    5 +-
 Makefile                              |   58 +++--
 README.md                             |    4 +-
 docs/api.md                           |  154 +++++++++--
 docs/commands.md                      |   90 +++----
 docs/commands/aliases.md              |    4 +-
 docs/commands/assemble.md             |   62 ++++-
 docs/commands/capstone-disassemble.md |   12 +-
 docs/commands/context.md              |   12 +
 docs/commands/dereference.md          |   21 +-
 docs/commands/elf-info.md             |   57 ++++-
 docs/commands/functions.md            |   33 ++-
 docs/commands/gef-remote.md           |   48 ++--
 docs/commands/heap-analysis-helper.md |    2 +
 docs/commands/heap.md                 |   77 +++---
 docs/commands/help.md                 |    8 +-
 docs/commands/hexdump.md              |   46 ++--
 docs/commands/ida-interact.md         |    3 +-
 docs/commands/ksymaddr.md             |    4 +
 docs/commands/memory.md               |    4 +-
 docs/commands/name-break.md           |   14 +-
 docs/commands/nop.md                  |    9 +-
 docs/commands/patch.md                |    8 +-
 docs/commands/pattern.md              |   48 ++--
 docs/commands/pie.md                  |   74 +++---
 docs/commands/print-format.md         |   18 +-
 docs/commands/process-search.md       |   27 +-
 docs/commands/process-status.md       |    2 +-
 docs/commands/registers.md            |   20 +-
 docs/commands/reset-cache.md          |    5 +-
 docs/commands/scan.md                 |   25 +-
 docs/commands/set-permission.md       |   25 +-
 docs/commands/stub.md                 |   12 +-
 docs/commands/tmux-setup.md           |   16 +-
 docs/commands/unicorn-emulate.md      |   36 +--
 docs/commands/version.md              |   36 +++
 docs/commands/vmmap.md                |    2 +-
 docs/commands/xinfo.md                |    2 +-
 docs/config.md                        |   38 ++-
 docs/faq.md                           |    5 +-
 docs/index.md                         |   81 +++---
 docs/requirements.txt                 |    2 +-
 docs/screenshots.md                   |   24 +-
 gef.py                                | 1436 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++---------------------------
 mkdocs.yml                            |    1 +
 requirements.txt                      |    3 +
 scripts/gef.sh                        |   35 ++-
 scripts/new-release.py                |  145 +++++++++++
 scripts/new-release.sh                |   13 -
 tests/binaries/Makefile               |   10 +-
 tests/binaries/bss.c                  |    3 +-
 tests/binaries/heap-fastbins.c        |   34 +--
 tests/binaries/heap-multiple-heaps.c  |   54 ++++
 tests/binaries/heap-non-main.c        |    3 +-
 tests/binaries/heap-tcache.c          |    3 +-
 tests/binaries/heap.c                 |    6 +-
 tests/binaries/memwatch.c             |   12 +
 tests/binaries/nested.c               |    3 +-
 tests/binaries/nested2.c              |    3 +-
 tests/binaries/set-permission.c       |    4 +-
 tests/binaries/unicorn.c              |   14 +
 tests/binaries/utils.h                |   44 ++++
 tests/helpers.py                      |  158 ++++++++----
 tests/runtests.py                     |  569 +++++++++++++++++++++++++++++++----------
 70 files changed, 2832 insertions(+), 1033 deletions(-)

---

This discussion was created from the release 2021.10 - Royal Kill.