Telemetry: save if Read the Docs creates a conf.py file for the project

[humitos]

It would be good to save into the build data if Read the Docs is creating the Sphinx's conf.py file for them. Sometimes we refer to this as the Magic Builder.

We are currently logging this into New Relic:

readthedocs.org/readthedocs/doc_builder/backends/sphinx.py

Lines 65 to 69 in 575afb8

	log.info(
	'Creating default Sphinx config file for project.',
	project_slug=self.project.slug,
	version_slug=self.version.slug,
	)

and we can see the data at https://onenr.io/0qQa3nMA5R1. We had 1.6k projects in the last 90 days.

Note that it seems this feature it's not heavily used, so it may not be super useful to start storing it into our database and it may be more useful to start thinking about its deprecation instead.

[humitos]

I think we can re-purpose this issue at some point and instead of start logging data in Telemetry database, talk more about deprecate this feature and avoid auto-creation of a conf.py file for projects that don't have one. See #9779 for more information about the deprecation patterns we are following.

[humitos]

I grepped the logs because NR only gives me the result for 1k project slugs only. Maybe there is a way to get more, but I didn't find it.

zgrep "Creating default Sphinx config file for project." /var/log/readthedocs/*.log* > project-conf-py-2023-06-30.txt

In [1]: lines = open('project-conf-py-2023-06-30.txt').readlines()

In [2]: projects = set()
   ...: for l in lines:
   ...:     projects.add(l.split('project_slug=')[1].split()[0])

In [3]: len(projects)
Out[3]: 1551

So, we have 1.5k projects that are using this feature. I will check how many of them are valid/active/non-spam now.

[humitos]

It seems we already agreed on removing this feature at #9562 (comment). So, I'll close this issue and follow the conversation there.