[精讚] [會員登入]
143

python 解析資料, 輸入並輸出 database, csv, pdf(二)

延續上篇 https://n.sfs.tw/content/index/16452 parse html class B

分享此文連結 //n.sfs.tw/16454

分享連結 python 解析資料, 輸入並輸出 database, csv, pdf(二)@igogo
(文章歡迎轉載,務必尊重版權註明連結來源)
2024-10-23 10:09:52 最後編修
2024-09-24 14:24:22 By igogo
 

 

 

延續上篇 https://n.sfs.tw/content/index/16452

 

parse html

class Base(DeclarativeBase):
    pass

class School(Base):
    __tablename__ = "school"

    name: Mapped[str] = mapped_column(primary_key=True)
    level: Mapped[str] = mapped_column(String(30))
    date: Mapped[str] = mapped_column(String(30))

    # Constructor to initialize attributes

    def __init__(self, name, level, date):
        self.name = name
        self.level = level
        self.date = date


schools = []

for i in range(1, 13):

    file = str(i) + ".html"
    print(file)
    # Opening the html file
    HTMLFile = open(file, "r", encoding="utf-8")
    # Reading the file
    index = HTMLFile.read()

    # Creating a BeautifulSoup object and specifying the parser
    soup = BeautifulSoup(index, 'html.parser')

    for item in soup.select('div.item'):
        for title in (item.select("div.list-title")):
            if title.text == "機關名稱":
                school = (item.select_one("div.list-content"))
        name = school.text.strip()
        level = item.select_one("span.item-level").text.strip()
        date = (item.select_one("span.item-date")).text.strip()
        if "國小" in name or \
            "國中" in name or \
            "高中" in name or \
            "國民小學" in name or \
            "國民中學" in name or \
            "學校" in name or \
                "高級中學" in name:
            if not any(map(lambda school: school.name == name, schools)):
                school = School(name, level, date)
                schools.append(school)

 

利用sqlalchemy orm  連接sqlite 寫入資料


# 寫入資料庫
engine = create_engine("sqlite:///school.db", echo=True)
session = Session(engine)

for school in schools:
    stmt = select(School).where(School.name == school.name)
    if not session.scalars(stmt).first():
        session.add(school)
        session.commit()
    else:
        print("done." + school.name)

#讀出資料庫裡所有資料
stmt = select(School)
result =  session.scalars(stmt)
schools = []
for school in result:
   schools.append(school) 

 

輸出csv

 

i=1
with open('summary統計.csv', 'w', newline='', encoding="utf-8") as csvfile:
    # 建立 CSV 檔寫入器
    writer = csv.writer(csvfile)
    writer.writerow(["通過校數:"+ str(len(schools))])
    for school in schools:
            writer.writerow([i,school.name, school.level, school.date])
            i=i+1

csvfile.close

 

輸出pdf

 

pdf = FPDF()
# Add a Unicode free font
pdf.add_font(fname='TW-Kai-98_1.ttf')
pdf.set_font('TW-Kai-98_1', size=16)

pdf.add_page()
pdf.cell(0, 20, 'summary統計', new_x="LMARGIN", new_y="NEXT", align='C')

pdf.set_font('TW-Kai-98_1', size=12)

x1 = 100
x2 = 40
x3 = 40
sn = 5
pdf.set_draw_color(0, 80, 180)
pdf.cell(sn, 10, " ", border="B")
pdf.cell(x1, 10, summary, border="B")
pdf.cell(x2, 10, "", border="B")
pdf.cell(x3, 10, "", border="B", new_x="LMARGIN", new_y="NEXT")
i = 0
for school in schools:
    i = i+1
    pdf.cell(sn, 10, str(i))
    pdf.cell(x1, 10, school.name)
    pdf.cell(x2, 10, school.level)
    pdf.cell(x3, 10, school.date, new_x="LMARGIN", new_y="NEXT")
pdf.output('summary統計.pdf')

Cell width. If 0, the cell extends up to the right margin.

x1 = 100, 表示這個cell 往右延伸 100個單位

下一個x2 就會從x1的寬度再開始計算40

http://www.fpdf.org/en/doc/cell.htm

 

參考

https://py-pdf.github.io/fpdf2/Tutorial.html

END

你可能感興趣的文章

python+curl 爬資料(一) 需要某網站資料抓回來統計,結果當然沒我想的那麼簡單, 程式跑一跑就撈回來 光這裡就卡好久, 後來觀察cookie 從 c

找尋多個文件夾中最新檔案(jpg,png,txt)並複製到nexus資料夾 找尋多個文件夾中最新檔案(jpg,png,txt)並複製到集中資料夾

python 的RE python re

python 解析資料, 輸入並輸出 database, csv, pdf(二) 延續上篇 https://n.sfs.tw/content/index/16452 parse html class B

00-F2 的 IPV6 反解設定 近日, 強者我的大神同事, line 傳來一句: igogo 上次你那個ipv6的設定檔 再幫我跑一次 如連結 程式都寫

我有話要說

>>

限制:留言最高字數1000字。 限制:未登入訪客,每則留言間隔需超過10分鐘,每日最多5則留言。

訪客留言

[無留言]

隨機好文

臺中市雲端校務系統與Windows AD帳號整合(5) 安裝java環境

在docker裡跑spring boot+mongo(一) 系統安裝docker ce centos7 + docker ce https://docs.docker.com/in

proxmox zfs 建立異地備份與還原 zfs最吸引人的地方就是可以建立快照並傳輸到遠端机器, 達到增量備份, 並且隨時從任一備份檔還原 完全不怕勒索病毒 將v

使用expect及 openssl 產生SSL 憑證簽署要求 每年都要製做tls 憑證 二十幾張, 此語法利用expect 產生私錀及憑證請求檔 #!/usr/bin/expect

批次檢查tls憑證是否過期 tls憑證一年一簽, 台中市有三百多所學校, 寫成一檔案 skaps.tc.edu.tw www.skaps.tc.ed