dmy 6d626a0946 feat: 新增多个电力集团采购平台爬虫
- 新增4个电力集团采购平台爬虫:
  * 中国大唐集团电子商务平台 (CdtCrawler)
  * 大连能源采购平台 (CeicCrawler)
  * 华润守正采购交易平台 (SzecpCrawler)
- 更新 BidCrawlerService,集成新的爬虫到爬虫任务中
- 添加环境变量示例文件 .env.example,包含数据库和代理配置
- 优化 .env 文件,添加代理配置示例
- 为所有新爬虫添加完整的单元测试文件
- 使用与现有爬虫相同的反检测策略(人类行为模拟)
- 支持分页抓取,每个平台最多抓取5页数据
- 统一的错误处理机制,单个爬虫失败不影响其他爬虫执行
2026-01-11 22:34:38 +08:00
2026-01-09 23:18:52 +08:00
2026-01-09 23:18:52 +08:00
2026-01-09 23:18:52 +08:00
2026-01-09 23:18:52 +08:00
2026-01-09 23:18:52 +08:00
2026-01-09 23:18:52 +08:00
2026-01-09 23:18:52 +08:00
2026-01-09 23:18:52 +08:00
2026-01-09 23:18:52 +08:00
2026-01-09 23:18:52 +08:00
2026-01-09 23:18:52 +08:00
2026-01-09 23:18:52 +08:00

Nest Logo

A progressive Node.js framework for building efficient and scalable server-side applications.

NPM Version Package License NPM Downloads CircleCI Discord Backers on Open Collective Sponsors on Open Collective Donate us Support us Follow us on Twitter

Description

Nest framework TypeScript starter repository.

Project setup

$ npm install

Compile and run the project

# development
$ npm run start

# watch mode
$ npm run start:dev

# production mode
$ npm run start:prod

Run tests

# unit tests
$ npm run test

# e2e tests
$ npm run test:e2e

# test coverage
$ npm run test:cov

Deployment

When you're ready to deploy your NestJS application to production, there are some key steps you can take to ensure it runs as efficiently as possible. Check out the deployment documentation for more information.

If you are looking for a cloud-based platform to deploy your NestJS application, check out Mau, our official platform for deploying NestJS applications on AWS. Mau makes deployment straightforward and fast, requiring just a few simple steps:

$ npm install -g @nestjs/mau
$ mau deploy

With Mau, you can deploy your application in just a few clicks, allowing you to focus on building features rather than managing infrastructure.

Resources

Check out a few resources that may come in handy when working with NestJS:

  • Visit the NestJS Documentation to learn more about the framework.
  • For questions and support, please visit our Discord channel.
  • To dive deeper and get more hands-on experience, check out our official video courses.
  • Deploy your application to AWS with the help of NestJS Mau in just a few clicks.
  • Visualize your application graph and interact with the NestJS application in real-time using NestJS Devtools.
  • Need help with your project (part-time to full-time)? Check out our official enterprise support.
  • To stay in the loop and get updates, follow us on X and LinkedIn.
  • Looking for a job, or have a job to offer? Check out our official Jobs board.

Support

Nest is an MIT-licensed open source project. It can grow thanks to the sponsors and support by the amazing backers. If you'd like to join them, please read more here.

Stay in touch

License

Nest is MIT licensed.

How to Run:

  1. Database Setup: Update the .env file with your PostgreSQL credentials.

1 DATABASE_TYPE=postgres 2 DATABASE_HOST=localhost 3 DATABASE_PORT=5432 4 DATABASE_USERNAME=your_username 5 DATABASE_PASSWORD=your_password 6 DATABASE_NAME=bidding 7 DATABASE_SYNCHRONIZE=true 2. Install Dependencies: 1 npm install 2 cd frontend && npm install 3. Build and Start:

1 # From the root directory 2 cd frontend && npm run build 3 cd .. 4 npm run build 5 npm run start

The system will automatically initialize with the preset keywords: "山东", "海", "建设", "工程", "采购". You can manage these and view crawled bidding information at http://localhost:3000.

Description
No description provided
Readme 1.1 MiB
Languages
TypeScript 63.1%
Vue 26.8%
JavaScript 3.8%
Go 3.5%
CSS 2%
Other 0.8%