Large Language Model Open Course > AI Advanced Workshop
Advanced LLM Inference, Preprocessing, and Agent Workshop
This course offers an in-depth exploration of the latest advancements and implementation practices for Large Language Models (LLMs) Development. Key topics include model inference and performance evaluation, data preprocessing for unstructured inputs, and document intelligence techniques. parts will gain deep knowledge about different mainstream models' inference details, experience about complex model data processing methodologies, and first-hand experience in deploying LLM agents across practical scenarios such as financial statement analysis, agent configuration, workflow orchestration, and the use of agentic methods in dynamic environments. Taught by leading academics and industry experts, the program combines foundational theory with applied learning to empower parts with the knowledge and skills to design, evaluate, and implement LLM solutions in operational settings.
Workshop Agenda
Participants
Pricing
Offline Knowledge Sharing
Session 1 : Inference
Day 1 - AM
9:00-10:00
Inference framework and performance testing benchmark
Introduce how 6estates do inference with different framework and how 6estates do inference performance test for different scenarios (both model level and system level)
Day 1 - AM
10:00-11:00
Performance testing results
Share the tested model inference performance results for the given model list and do comparison
Day 1 - AM
11:00-12:00
Discussion about model serving and model selection
Discuss based on the knowledge sharing and results sharing, to help select proper model and proper framework for different usage scenarios
Session 2: Data Preprocessing
Day 1 - PM
14:00-15:00
General document processing with layout aware structure
Share the general document processing methods and how to form different input formats for further model usage (plain text, text with layout, text with image)
Day 1 - PM
15:00-16:00
E-pdf specific processing and scan-pdf specific processing
Share the specific format document processing techniques based on 6Estates experience for complex documents
Day 1 - PM
16:00-17:00
Discussion about preprocessing for client data
Discuss based on the knowledge sharing and results sharing, to help recommend the proper methods for processing client's own data
Session 3-1: Document Agent
Day 2 - AM
09:00-10:00
Introduce 6Estates document agent
Introduce 6Estates' platform with information extraction function and document agent function, takeing handle trading documents and process business logic as example to show the agent configuration and workflow
Day 2 - AM
10:00-11:00
Introduce 6Estates agent framework
Introduce the backend system infrastructure and agent building experience
Day 2 - AM
11:00-12:00
Discussion about client agent building
Discuss based on the knowledge sharing and results sharing, to help recommend the proper methods for client's agent building
Session 3-2: Agent in Industry
Day 2 - PM
14:00-15:00
Agent use case sharing
Invite external expert to share more use cases for agentic techniques
Day 2 - PM
15:00-16:00
Final Discussion
Discuss any topic based on the whole workshop session