Add preprocess function to split whitespace before romanize

[pavaris-pm]

What does this PR changes

@wannaphong According to issue #922 there is room of improvement in transliterate function, where splitting whitespace yield much better performance. What do you think about it ? actually, we can improve this performance by adding tokenization module into the game so that the text can be splitted more logically too. Anyway, please let me know what do you think krub.

from pythainlp.transliterate import romanize

A = "สวัสดี ครับ"
B = "คุณ ชื่อ อะไร ครับ"
A_B = "สวัสดี ครับ คุณ ชื่อ อะไร ครับ"
print(romanize(A, engine="thai2rom"))
print(romanize(B, engine="thai2rom"))
print(romanize(A_B, engine="thai2rom"))
for z in A_B.split(' '):
    roman = romanize(z, engine="thai2rom")
    print(roman, ' ', end="")

# output: 
# sawatdi khrap
# khun chue arai khrap
# sawatdi khrap khun chuen chuen chuen chuen chuen chuen chuen chuen chuen chuen chuen chuen chuen chu
# sawatdi  khrap  khun  chue  arai  khrap 

Now, i've fixed it, and got a preprocessing of the input text during the function execution

from pythainlp.transliterate import romanize
A_B = "สวัสดี ครับ คุณ ชื่อ อะไร ครับ"
print(romanize(A_B, engine="thai2rom"))
# output: sawatdikhrapkhunchuearaikhrap

ps. just want to know that did PyThaiNLP joined Hacktoberfest 2024 thsi year ? please let me know

Your checklist for this pull request

🚨Please review the guidelines for contributing to this repository.

• Passed code styles and structures
• Passed code linting checks and unit test

[pep8speaks]

Hello @pavaris-pm! Thanks for updating this PR. We checked the lines you've touched for PEP 8 issues, and found:

There are currently no PEP 8 issues detected in this Pull Request. Cheers! 🍻

Comment last updated at 2024-10-06 14:55:57 UTC

[sonarcloud]

Quality Gate passed

Issues
0 New issues
0 Accepted issues

Measures
0 Security Hotspots
0.0% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarCloud

[wannaphong]

Thank you! PyThaiNLP is already join Hacktoberfest 2024 thsi year!

[wannaphong]

Thank you!