74a4aec363
- 新增 PowerbeijingCrawler 爬虫类，支持北京电力交易平台招标信息抓取 - 目标平台：https://www.powerbeijing-ec.com，专注于北京地区电力交易招标信息 - 使用正则表达式提取招标公告，支持标题、URL和发布日期解析 - 添加完整的人类行为模拟功能（鼠标移动、滚动）降低检测风险 - 支持分页抓取，最多抓取5页数据，使用 turnPage 函数进行翻页 - 添加完整的单元测试文件，确保爬虫功能正常 - 统一的错误处理机制，单个爬虫失败不影响整体任务执行
A progressive Node.js framework for building efficient and scalable server-side applications.
Description
Nest framework TypeScript starter repository.
Project setup
$ npm install
Compile and run the project
# development
$ npm run start
# watch mode
$ npm run start:dev
# production mode
$ npm run start:prod
Run tests
# unit tests
$ npm run test
# e2e tests
$ npm run test:e2e
# test coverage
$ npm run test:cov
Deployment
When you're ready to deploy your NestJS application to production, there are some key steps you can take to ensure it runs as efficiently as possible. Check out the deployment documentation for more information.
If you are looking for a cloud-based platform to deploy your NestJS application, check out Mau, our official platform for deploying NestJS applications on AWS. Mau makes deployment straightforward and fast, requiring just a few simple steps:
$ npm install -g @nestjs/mau
$ mau deploy
With Mau, you can deploy your application in just a few clicks, allowing you to focus on building features rather than managing infrastructure.
Resources
Check out a few resources that may come in handy when working with NestJS:
- Visit the NestJS Documentation to learn more about the framework.
- For questions and support, please visit our Discord channel.
- To dive deeper and get more hands-on experience, check out our official video courses.
- Deploy your application to AWS with the help of NestJS Mau in just a few clicks.
- Visualize your application graph and interact with the NestJS application in real-time using NestJS Devtools.
- Need help with your project (part-time to full-time)? Check out our official enterprise support.
- To stay in the loop and get updates, follow us on X and LinkedIn.
- Looking for a job, or have a job to offer? Check out our official Jobs board.
Support
Nest is an MIT-licensed open source project. It can grow thanks to the sponsors and support by the amazing backers. If you'd like to join them, please read more here.
Stay in touch
- Author - Kamil Myśliwiec
- Website - https://nestjs.com
- Twitter - @nestframework
License
Nest is MIT licensed.
How to Run:
- Database Setup: Update the .env file with your PostgreSQL credentials.
1 DATABASE_TYPE=postgres 2 DATABASE_HOST=localhost 3 DATABASE_PORT=5432 4 DATABASE_USERNAME=your_username 5 DATABASE_PASSWORD=your_password 6 DATABASE_NAME=bidding 7 DATABASE_SYNCHRONIZE=true 2. Install Dependencies: 1 npm install 2 cd frontend && npm install 3. Build and Start:
1 # From the root directory 2 cd frontend && npm run build 3 cd .. 4 npm run build 5 npm run start
The system will automatically initialize with the preset keywords: "山东", "海", "建设", "工程", "采购". You can manage these and view crawled bidding information at http://localhost:3000.