Update argilla integration to use argilla_sdk v2

[alvarobartt]

Description

This PR renames and updates Argilla to ArgillaBase, since now the client in argilla_sdk (later to be renamed to argilla only as per a recent discussion with @frascuchon) is named Argilla too. Besides that, the code has been updated to use the latest Python client instead not only for ArgillaBase but also for the subclasses TextGenerationToArgilla and PreferenceToArgilla.

Warning

This change here implies that the argilla server version should be 1.27.0 or higher, otherwise the argilla_sdk won't work.

Closes argilla-io/argilla#4880

[burtenshaw]

Nice start. Just a few high level comments.

[alvarobartt]

Edit: the issue was with the Argilla Server version as I was using 1.26.0 while 1.27.0 or higher was required 👍🏻

As an update @burtenshaw @frascuchon I've installed argilla_sdk from the latest version of argilla-python in main and running the code below, leads to the following exception, complaining about not finding the /records/bulk endpoint, could you try to reproduce on your end?

---

Install as pip install "distilabel[hf-inference-endpoints] @ git+https://github.com/argilla-io/[email protected]" and then run the code below with your personal HF_TOKEN and your Argilla credentials (feel free to use dev):

from uuid import uuid4

from distilabel.llms import InferenceEndpointsLLM
from distilabel.pipeline.local import Pipeline
from distilabel.steps import (
    LoadDataFromDicts,
    TextGenerationToArgilla,
)
from distilabel.steps.tasks import TextGeneration

if __name__ == "__main__":
    with Pipeline(name="my-pipeline") as pipeline:
        load_dataset = LoadDataFromDicts(
            name="load_dataset",
            data=[
                {
                    "instruction": "Write a short story about a dragon that saves a princess from a tower.",
                },
            ],
        )

        text_generation = TextGeneration(
            name="text_generation",
            llm=InferenceEndpointsLLM(
                model_id="meta-llama/Meta-Llama-3-8B-Instruct",
                tokenizer_id="meta-llama/Meta-Llama-3-8B-Instruct",
                api_key="...",  # type: ignore
            ),
            num_generations=4,
            group_generations=True,
        )

        text_generation_to_argilla = TextGenerationToArgilla(
            name="text_generation_to_argilla",
            api_url="...",
            api_key="...",  # type: ignore
            dataset_name=f"text-generation-{uuid4()}",
            dataset_workspace="admin",
        )

        (  # type: ignore
            load_dataset
            >> text_generation
            >> text_generation_to_argilla
        )

    pipeline.run(
        parameters={
            text_generation.name: {  # type: ignore
                "llm": {
                    "generation_kwargs": {
                        "max_new_tokens": 512,
                        "temperature": 0.7,
                    },
                },
            },
        }
    )

The logs then look like:

[github-actions]

Documentation for this PR has been built. You can view it at: https://distilabel.argilla.io/pr-705/

[codspeed-hq]

CodSpeed Performance Report

Merging #705 will not alter performance

_{Comparing argilla-2.0 (b0a6b71) with develop (be61d20)}

Summary

✅ 1 untouched benchmarks