极坐标中的字符串操作

Question

我在极地有一项记录，到目前为止还没有标题。该标题应引用记录的第一行。在将此行实例化为标题之前，我想操作这些条目。

import polars as pl
# Creating a dictionary with the data
data = {
    "Column_1": ["ID", 4, 4, 4, 4],
    "Column_2": ["LocalValue", "B", "C", "D", "E"],
    "Column_3": ["Data\nField", "Q", "R", "S", "T"],
    "Column_4": [None, None, None, None, None],
    "Column_5": ["Global Value", "G", "H", "I", "J"],
}
# Creating the dataframe
table = pl.DataFrame(data, strict=False)
print(table)

shape: (5, 5)
┌──────────┬────────────┬──────────┬──────────┬──────────────┐
│ Column_1 ┆ Column_2   ┆ Column_3 ┆ Column_4 ┆ Column_5     │
│ ---      ┆ ---        ┆ ---      ┆ ---      ┆ ---          │
│ str      ┆ str        ┆ str      ┆ null     ┆ str          │
╞══════════╪════════════╪══════════╪══════════╪══════════════╡
│ ID       ┆ LocalValue ┆ Data     ┆ null     ┆ Global Value │
│          ┆            ┆ Field    ┆          ┆              │
│ 4        ┆ B          ┆ Q        ┆ null     ┆ G            │
│ 4        ┆ C          ┆ R        ┆ null     ┆ H            │
│ 4        ┆ D          ┆ S        ┆ null     ┆ I            │
│ 4        ┆ E          ┆ T        ┆ null     ┆ J            │
└──────────┴────────────┴──────────┴──────────┴──────────────┘

首先，我想用下划线替换单词之间的换行符和空格。此外，我想用下划线填充骆驼箱（例如 TestTest -> Test_Test）。最后，所有条目都应该小写。为此，我编写了以下函数：

def clean_dataframe_columns(df):
    header = list(df.head(1).transpose().to_series())
    cleaned_headers = []
    for entry in header:
        if entry:
            entry = (
                entry.replace("\n", "_")
                .replace("(?<=[a-z])(?=[A-Z])", "_")
                .replace("\s", "_")
                .to_lowercase()
            )
        else:
            entry = "no_column"
        cleaned_headers.append(entry)
    df.columns = cleaned_headers
    return df

不幸的是我有以下错误。我做错了什么？

# AttributeError: 'int' object has no attribute 'replace'

目标应该是这个数据框：

shape: (4, 5)
┌─────┬─────────────┬────────────┬───────────┬──────────────┐
│ id  ┆ local_value ┆ data_field ┆ no_column ┆ global_value │
│ --- ┆ ---         ┆ ---        ┆ ---       ┆ ---          │
│ i64 ┆ str         ┆ str        ┆ f64       ┆ str          │
╞═════╪═════════════╪════════════╪═══════════╪══════════════╡
│ 4   ┆ B           ┆ Q          ┆ null      ┆ G            │
│ 4   ┆ C           ┆ R          ┆ null      ┆ H            │
│ 4   ┆ D           ┆ S          ┆ null      ┆ I            │
│ 4   ┆ E           ┆ T          ┆ null      ┆ J            │
└─────┴─────────────┴────────────┴───────────┴──────────────┘

Answer 1

这里

for entry in header:

你迭代了python字符串，所以你应该使用相应的方法（比如

.lower()

而不是

.to_lowercase()

）。

---

重写sol-n：

import re

def get_cols(raw_col):
    if raw_col is None: return "no_column"
    raw_col = re.sub("(?<=[a-z])(?=[A-Z])", "_", raw_col)
    return raw_col.replace("\n", "_").replace(" ", "_").lower()


def clean_dataframe_columns(df):
    raw_cols = table.head(1).transpose().to_series().to_list()

    return df.rename({
        col: get_cols(raw_col) for col, raw_col in zip(df.columns, raw_cols)
    }).slice(1).with_column(pl.col("id").fill_null(4).cast(pl.Int32))

┌─────┬─────────────┬────────────┬───────────┬──────────────┐
│ id  ┆ local_value ┆ data_field ┆ no_column ┆ global_value │
│ --- ┆ ---         ┆ ---        ┆ ---       ┆ ---          │
│ str ┆ str         ┆ str        ┆ f64       ┆ str          │
╞═════╪═════════════╪════════════╪═══════════╪══════════════╡
│ 4   ┆ B           ┆ Q          ┆ null      ┆ G            │
│ 4   ┆ C           ┆ R          ┆ null      ┆ H            │
│ 4   ┆ D           ┆ S          ┆ null      ┆ I            │
│ 4   ┆ E           ┆ T          ┆ null      ┆ J            │
└─────┴─────────────┴────────────┴───────────┴──────────────┘

Answer 2

我自己用这个方法解决了：

def clean_select_columns(self, df: pl.DataFrame) -> pl.DataFrame:
    """
    Clean columns from a dataframe.

    :param df: input Dataframe
    :return: Dataframe with cleaned columns

    The function takes a loaded Dataframe and performs the following operations:

        Transposes the first row of the dataframe to get the header
        Selects the required columns defined in the list required_columns
        Cleans the header names by:
            1. Replacing special characters with underscores
            2. Converting CamelCase strings to snake_case strings
            3. Converting all columns to lowercase
            4. Naming columns with no names as "no_column_X", where X is a unique integer
            5. Returns the cleaned dataframe.
    """
    header = list(df.head(1).transpose().to_series())
    cleaned_headers = []
    i = 0
    for entry in header:
        if entry:
            entry = (
                re.sub(r"(?i)([\n ?])", "",
                re.sub(r"(?<!^)(?=[A-Z][a-z])", "_", entry))
                .lower()
            )
        else:
            entry = f"no_column_{i}"
        cleaned_headers.append(entry)
        i += 1
    df.columns = cleaned_headers
    return df