NucEngineer
Nuclear
- Jul 26, 2015
- 5
Hello forum! First time poster here and I'm in a pinch. If you want to jump ahead to the question, it’s at the end. The short of it is that I have to figure out the simplest way to analyze a large amount of data that will be compared with other data in order to determine if a system is operating within a desired range. I will give some background first, and then plug my question in at the end. Due to the nature of my work however, details will have to be limited.
The long of it:
I have been responsible for development and implementation of a new ventilation system. Think of it as a saw-dust collection system that might be used in a shop in the area around your saws, sanders, etc. to control the saw-dust as it’s generated.
This system was tested extensively in “mock-up” conditions, where the inward air velocity was measured at specific locations over and over again, and in different configurations. The system was tested at a “high flow rate” and a “low flow rate”. Provided everything was sat at the high flow rate and sat at the low flow rate, I could by default say that as long as this system was operating anywhere in-between these conditions, it will work.
Once the system is installed and operational at the job site, I have to go test it and compare my job-site data with the data obtained during mockup testing to determine that it’s operating within the desired range. For reasons that I don’t want to discuss, I cannot use flow rates or differential pressures as monitored by the fans pulling the air through the system. Air velocity at the system opening is the only means of “evaluation”.
For one “test” I have 16 locations around the perimeter and at each location, I have 3 vertical “test points” that I’ll call A, B, and C. While the A, B, and C test points are expected to provide different velocities with respect to each other, as a whole, an A test point is expected to provide similar velocities as all other A points, B similar to all other B points, and same for C. In addition to that, one test location as a whole is expected to behave similarly with respect to the other 15 test locations around the perimeter.
The last engineer royally screwed this up by taking the lowest of all values and the highest of all values seen during mockup testing, and used that as a blanket “go/no-go” range on the job site. It was a large spread, and all values taken at the job site were within his specified range. He failed to notice that all values were close to his max number, said it was good to go, and a catastrophic failure occurred. As an over-all average, the system was actually operating way outside of the designed and tested range.
Analyzing the data:
I need a simple method in determining that not only each data point at the job site falls within a range observed during testing, but that the distribution of those numbers are also within acceptable range comparable to mockup testing conditions.
This is the best method I have been able to come up with for job-site acceptance criteria. Remember that I have tested the system SAT at a “low flow” and a “high flow” condition. For the A test point, I pulled the lowest value observed in the “low flow” and the highest value observed during the “high flow”. For acceptance criteria at the job site, this will be the MIN and MAX value allowable for each A test point. The same process will apply for B and C respective to data obtained during testing for those points.
I then took the average of all A test points at the “low flow”, and the average of all A test points at the “high flow”. This will be the MIN and MAX range for the average of all A test points observed at the job site. Same will go for B and C.
So during job site evaluation, all A/B/C test points will be recorded at the 16 locations. Provided each of my recorded A test points fall within the individual MIN and MAX range, That is the first stage of acceptance criteria. Second stage will be to add all of the A job site test points and take the average. Provided the A test point average falls within the average MIN and MAX range, I know that for the A test point, it is in fact operating somewhere within the “low flow” and “high flow” range that was tested in mockup conditions. Obviously the same would follow suit for B, and C.
I may even take it a step further and compare the average for ALL job site test points relative to the average for ALL mockup test points to make sure that it is operating within the same range as a whole.
QUESTION:
Is this the most efficient way to analyze this data for acceptance criteria, in order to say “YES” it is operating within a desired range or “NO” it is not? Is there a more simple way to do it?
Thanks for all the help!
The long of it:
I have been responsible for development and implementation of a new ventilation system. Think of it as a saw-dust collection system that might be used in a shop in the area around your saws, sanders, etc. to control the saw-dust as it’s generated.
This system was tested extensively in “mock-up” conditions, where the inward air velocity was measured at specific locations over and over again, and in different configurations. The system was tested at a “high flow rate” and a “low flow rate”. Provided everything was sat at the high flow rate and sat at the low flow rate, I could by default say that as long as this system was operating anywhere in-between these conditions, it will work.
Once the system is installed and operational at the job site, I have to go test it and compare my job-site data with the data obtained during mockup testing to determine that it’s operating within the desired range. For reasons that I don’t want to discuss, I cannot use flow rates or differential pressures as monitored by the fans pulling the air through the system. Air velocity at the system opening is the only means of “evaluation”.
For one “test” I have 16 locations around the perimeter and at each location, I have 3 vertical “test points” that I’ll call A, B, and C. While the A, B, and C test points are expected to provide different velocities with respect to each other, as a whole, an A test point is expected to provide similar velocities as all other A points, B similar to all other B points, and same for C. In addition to that, one test location as a whole is expected to behave similarly with respect to the other 15 test locations around the perimeter.
The last engineer royally screwed this up by taking the lowest of all values and the highest of all values seen during mockup testing, and used that as a blanket “go/no-go” range on the job site. It was a large spread, and all values taken at the job site were within his specified range. He failed to notice that all values were close to his max number, said it was good to go, and a catastrophic failure occurred. As an over-all average, the system was actually operating way outside of the designed and tested range.
Analyzing the data:
I need a simple method in determining that not only each data point at the job site falls within a range observed during testing, but that the distribution of those numbers are also within acceptable range comparable to mockup testing conditions.
This is the best method I have been able to come up with for job-site acceptance criteria. Remember that I have tested the system SAT at a “low flow” and a “high flow” condition. For the A test point, I pulled the lowest value observed in the “low flow” and the highest value observed during the “high flow”. For acceptance criteria at the job site, this will be the MIN and MAX value allowable for each A test point. The same process will apply for B and C respective to data obtained during testing for those points.
I then took the average of all A test points at the “low flow”, and the average of all A test points at the “high flow”. This will be the MIN and MAX range for the average of all A test points observed at the job site. Same will go for B and C.
So during job site evaluation, all A/B/C test points will be recorded at the 16 locations. Provided each of my recorded A test points fall within the individual MIN and MAX range, That is the first stage of acceptance criteria. Second stage will be to add all of the A job site test points and take the average. Provided the A test point average falls within the average MIN and MAX range, I know that for the A test point, it is in fact operating somewhere within the “low flow” and “high flow” range that was tested in mockup conditions. Obviously the same would follow suit for B, and C.
I may even take it a step further and compare the average for ALL job site test points relative to the average for ALL mockup test points to make sure that it is operating within the same range as a whole.
QUESTION:
Is this the most efficient way to analyze this data for acceptance criteria, in order to say “YES” it is operating within a desired range or “NO” it is not? Is there a more simple way to do it?
Thanks for all the help!