Test Data Preparation for topcoder Permission related performance improvement

Key Information

Register
Submit
The challenge is finished.

Challenge Overview

We are going to improve the performance of the topcoder Direct, and in this assembly we want to generate and load bulk data on VM to make the data set volumn/complecity closer to what it is in prod. This will help us to measure the performance on VM. Data for the following tables should be generated and loaded:

  1. tc_direct_project (10000)

  2. user_permission_grant (6 * 10000)

  3. group_associated_direct_projects (10000)

  4. customer_group (500)

  5. group_member (500*10)

  6. corporate_oltp:direct_project_account (10000 * 1)

  7. group_associated_billing_accounts (500 * 2)

  8. tt_project (1000 * 3) -> time_oltp:project

  9. tt_client_project (1000 *3) -> time_oltp:client_project

  10. tt_client (1000) -> time_oltp:client

  11. project_info (200 * 10000)

  12. project (50000)

  13. customer_administrator (50)

  14. user_role_xref (20 * 10000)

The numbers after the table name is the volume (the number of database records) of the data we want to generated.

Requirements

  • The code should be modular and easy to add new data generation.
  • The data volume should be configurable.
  • Ant script to generate and load the data into configured database is needed.

Environments

You need a TopCoder VM which has informix database to work on this challenge, please request the VM in the challenge forum.

Information about VM can be found below:

VM specific information is found here: http://apps.topcoder.com/wiki/display/projects/Direct+VM and http://www.topcoder.com/wiki/display/docs/VM+Image+2.5. Upon registration as a submitter or reviewer you will need to request a VM based on the new TopCoder Cockpit/Direct image. To request your image, please use the forum. Before requesting your VM, you need to ensure that you have an SSH key created and in your member profile. Instructions to do so are here: http://www.topcoder.com/wiki/display/projects/Generate+SSH+Key, and instructions to connect afterwards are here: http://www.topcoder.com/wiki/display/projects/Connect+Using+SSH+Key.

Database Schema:

SVN repo: https://coder.topcoder.com/internal/database/scripts/trunk/

If you don't have permission to access this SVN, please send an email to support@topcoder.com to request the permission.



Final Submission Guidelines

  • The whole package of the tool with deployment guide on how to use it.

ELIGIBLE EVENTS:

2015 topcoder Open

REVIEW STYLE:

Final Review:

Community Review Board

Approval:

User Sign-Off

SHARE:

ID: 30045419