Comments (10)
rayrod2030
commented on June 6, 2024
I ran into this as well and managed to get it working by clearing out the work s3 bucket as well as both reader and processer work directories and then restarting ice and letting it do the processing all over again. Not optimal but I think I probably disrupted it's previous processing run which led to bad rollup files in s3 work.
from ice.
adamsb6
commented on June 6, 2024
Yep, I've done that quite a bit. I've cleared them all again and I'm attempting another run with the reader component disabled.
from ice.
adamsb6
commented on June 6, 2024
I've noticed that at the end of my processor run I'll get an exception about the ondemandAlertMillis file not existing:
2013-06-20 23:18:52,283 [com.netflix.ice.processor.BillingFileProcessor] INFO processor.BillingFileProcessor - done archiving 2013-06-01T00:00:00.000Z
| Error 2013-06-20 23:18:52,325 [com.netflix.ice.processor.BillingFileProcessor] ERROR processor.BillingFileProcessor - Error reading from ondemandAlertMillis file
Message: The specified key does not exist.
Line | Method
->> 644 | handleErrorResponse in com.amazonaws.http.AmazonHttpClient
- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
| 338 | executeHelper in ''
| 190 | execute . . . . . . . in ''
| 2979 | invoke in com.amazonaws.services.s3.AmazonS3Client
| 911 | getObject . . . . . . in ''
| 801 | getObject in ''
| 720 | lastAlertMillis . . . in com.netflix.ice.processor.BillingFileProcessor
| 740 | sendOndemandCostAlert in ''
| 170 | poll . . . . . . . . in ''
| 50 | doWork in com.netflix.ice.common.Poller
| 28 | access$000 . . . . . in ''
| 88 | run in com.netflix.ice.common.Poller$1
^ 679 | run . . . . . . . . . in java.lang.Thread
2013-06-20 23:18:53,457 [com.netflix.ice.processor.BillingFileProcessor] INFO processor.BillingFileProcessor - AWS usage processed.
However, I figured this was by design, similar to how an error is printed in the logs for rollups not existing, and then ice goes on to create the missing rollups.
Do you think that could be the cause of my bad tag file?
from ice.
fangji
commented on June 6, 2024
@adamsb6
I suggest you do the following:
- get the latest code for Ice
- delete all files from your working s3 bucket
- delete all files from your local ice directory (for processor and reader)
- start Ice in processor mode. The ondemandAlertMillis file not existing error can be ignored.
- start Ice in reader mode.
from ice.
adamsb6
commented on June 6, 2024
No luck, same issue. Here's the full log for reader startup:
| Running Grails application
2013-06-20 23:47:57,981 [main] INFO http11.Http11Protocol - Initializing ProtocolHandler ["http-bio-8080"]
2013-06-20 23:47:58,503 [main] INFO core.StandardService - Starting service Tomcat
2013-06-20 23:47:58,513 [main] INFO core.StandardEngine - Starting Servlet Engine: Apache Tomcat/7.0.30
2013-06-20 23:47:59,932 [localhost-startStop-1] INFO startup.ContextConfig - No global web.xml found
2013-06-20 23:48:01,261 [localhost-startStop-1] INFO [localhost].[/ice] - Initializing Spring root WebApplicationContext
2013-06-20 23:48:25,874 [localhost-startStop-1] INFO scaffolding.DefaultGrailsTemplateGenerator - Scaffolding template generator set to use resource loader org.codehaus.groovy.grails.commons.spring.GrailsWebApplicationContext@15f068b9: startup date [Thu Jun 20 23:48:18 UTC 2013]; parent: Root WebApplicationContext
2013-06-20 23:48:34,785 [localhost-startStop-1] INFO context.GrailsConfigUtils - [GrailsContextLoader] Grails application loaded.
2013-06-20 23:48:34,971 [localhost-startStop-1] INFO BootStrap - Starting ice...
2013-06-20 23:48:38,475 [localhost-startStop-1] INFO basic.BasicManagers - trying to find new tag group and data managers...
2013-06-20 23:48:41,429 [localhost-startStop-1] INFO common.AwsUtils - downloadFileIfChanged /mnt/ice_reader/tagdb_all 1371771589000 0
2013-06-20 23:48:41,761 [localhost-startStop-1] INFO basic.BasicTagGroupManager - trying to read from /mnt/ice_reader/tagdb_all
| Error 2013-06-20 23:48:42,176 [localhost-startStop-1] ERROR basic.BasicTagGroupManager - cannot poll data
Message: null
Line | Method
->> 106 | hashCode in com.netflix.ice.common.TagGroup
- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
| 917 | get in java.util.concurrent.ConcurrentHashMap
| 119 | getTagGroup . . . . . . . . . . in com.netflix.ice.common.TagGroup
| 184 | deserialize in com.netflix.ice.common.TagGroup$Serializer
| 161 | deserializeTagGroups . . . . . . in ''
| 69 | poll in com.netflix.ice.basic.BasicTagGroupManager
| 54 | <init> . . . . . . . . . . . . . in ''
| 111 | doWork in com.netflix.ice.basic.BasicManagers
| 59 | init . . . . . . . . . . . . . . in ''
| 98 | <init> in com.netflix.ice.reader.ReaderConfig
| 156 | doCall . . . . . . . . . . . . . in BootStrap$_closure1
| 308 | evaluateEnvironmentSpecificBlock in grails.util.Environment
| 301 | executeForEnvironment . . . . . in ''
| 277 | executeForCurrentEnvironment in ''
| 334 | innerRun . . . . . . . . . . . . in java.util.concurrent.FutureTask$Sync
| 166 | run in java.util.concurrent.FutureTask
| 1146 | runWorker . . . . . . . . . . . in java.util.concurrent.ThreadPoolExecutor
| 615 | run in java.util.concurrent.ThreadPoolExecutor$Worker
^ 679 | run . . . . . . . . . . . . . . in java.lang.Thread
2013-06-20 23:48:43,121 [localhost-startStop-1] INFO basic.BasicTagGroupManager - poller thread for tagdb_all started...
2013-06-20 23:48:43,122 [tagdb_all] INFO basic.BasicTagGroupManager - poller starting...
2013-06-20 23:48:43,485 [tagdb_all] INFO common.AwsUtils - downloadFileIfChanged /mnt/ice_reader/tagdb_all 1371771589000 1371772121000
2013-06-20 23:48:43,485 [tagdb_all] INFO basic.BasicTagGroupManager - trying to read from /mnt/ice_reader/tagdb_all
2013-06-20 23:48:43,924 [localhost-startStop-1] INFO basic.BasicDataManager - poller thread for cost_hourly_all started...
2013-06-20 23:48:44,057 [localhost-startStop-1] INFO basic.BasicDataManager - poller thread for usage_hourly_all started...
2013-06-20 23:48:43,929 [cost_hourly_all] INFO basic.BasicDataManager - poller starting...
2013-06-20 23:48:44,058 [usage_hourly_all] INFO basic.BasicDataManager - poller starting...
2013-06-20 23:48:44,058 [localhost-startStop-1] INFO basic.BasicDataManager - poller thread for cost_daily_all started...
2013-06-20 23:48:44,062 [localhost-startStop-1] INFO basic.BasicDataManager - poller thread for usage_daily_all started...
2013-06-20 23:48:44,062 [usage_daily_all] INFO basic.BasicDataManager - poller starting...
2013-06-20 23:48:44,063 [cost_daily_all] INFO basic.BasicDataManager - poller starting...
2013-06-20 23:48:44,062 [localhost-startStop-1] INFO basic.BasicDataManager - poller thread for cost_weekly_all started...
2013-06-20 23:48:44,069 [localhost-startStop-1] INFO basic.BasicDataManager - poller thread for usage_weekly_all started...
2013-06-20 23:48:44,070 [usage_weekly_all] INFO basic.BasicDataManager - poller starting...
2013-06-20 23:48:44,070 [localhost-startStop-1] INFO basic.BasicDataManager - poller thread for cost_monthly_all started...
2013-06-20 23:48:44,134 [localhost-startStop-1] INFO basic.BasicDataManager - poller thread for usage_monthly_all started...
2013-06-20 23:48:44,135 [usage_monthly_all] INFO basic.BasicDataManager - poller starting...
2013-06-20 23:48:44,359 [cost_monthly_all] INFO basic.BasicDataManager - poller starting...
2013-06-20 23:48:44,137 [localhost-startStop-1] INFO basic.BasicManagers - poller thread for com.netflix.ice.basic.BasicManagers started...
2013-06-20 23:48:44,361 [com.netflix.ice.basic.BasicManagers] INFO basic.BasicManagers - poller starting...
2013-06-20 23:48:44,373 [com.netflix.ice.basic.BasicManagers] INFO basic.BasicManagers - trying to find new tag group and data managers...
2013-06-20 23:48:44,368 [cost_weekly_all] INFO basic.BasicDataManager - poller starting...
| Error 2013-06-20 23:48:44,390 [tagdb_all] ERROR basic.BasicTagGroupManager - Error polling
Message: null
Line | Method
->> 106 | hashCode in com.netflix.ice.common.TagGroup
- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
| 917 | get in java.util.concurrent.ConcurrentHashMap
| 119 | getTagGroup . . . . in com.netflix.ice.common.TagGroup
| 184 | deserialize in com.netflix.ice.common.TagGroup$Serializer
| 161 | deserializeTagGroups in ''
| 69 | poll in com.netflix.ice.basic.BasicTagGroupManager
| 50 | doWork . . . . . . . in com.netflix.ice.common.Poller
| 28 | access$000 in ''
| 88 | run . . . . . . . . in com.netflix.ice.common.Poller$1
^ 679 | run in java.lang.Thread
/mnt/ice_reader/tagdb_all is 155Kb. It does look like theres some character at the beginning that my console can't interpret, but it looks like this is a binary format anyway:
;S�4dreamboxap-northeast-1
cloudwatchListMetricsCW:Requestdreamboxap-southeast-1
cloudwatchListMetricsCW:Requestdreambox eu-west-1
cloudfrontGETDataTransfer-Out-BytesGdreambox eu-west-1
cloudfrontGETRequests-Tierdreambox eu-west-1
from ice.
fangji
commented on June 6, 2024
@adamsb6
I think this is caused by the fact that you have some aws product that does not exist in Product.java. I changed the code to enable dynamic creation of product while reading data. Please pull the latest code and try again.
from ice.
rayrod2030
commented on June 6, 2024
Also recreate your key and never use the one you posted in this thread.
—
Sent from Mailbox for iPhone
On Thu, Jun 20, 2013 at 9:23 PM, fangji [email protected] wrote:
I think this is caused by the fact that you have some aws product that does not exist in Product.java. I changed the code to enable dynamic creation of product while reading data. Please pull the latest code and try again.
Reply to this email directly or view it on GitHub:
#9 (comment)
from ice.
adamsb6
commented on June 6, 2024
Which key? I just reviewed my posts and searched the page for the AWS credentials I've used with Ice, I don't see anything.
from ice.
rayrod2030
commented on June 6, 2024
@adamsb6 Apologies for my comment I was referring to another issue where someone posted their key.
from ice.
adamsb6
commented on June 6, 2024
@rayrod2030 Ah, no problem. I appreciate the vigilance.
@fangji Looks like that fixed it! I just wonder how I ever get it working correctly in the first place.
Thanks for being so responsive, I've noticed that you've been fixing issues super quickly.
from ice.
Related Issues (20)
- ca-central-1 not shwoing up in UI HOT 3
- What is ice reports Timezone? HOT 2
- Project Status HOT 3
- ERROR basic.BasicReservationService - No Zone for ap-south-1c [doesn't actually exist] HOT 3
- JimRoth fork HOT 4
- Redshift RI's breaking ec2_instance costs
- Since the 12th of July 2019, EC2 reserved instances billing stopped working... HOT 6
- Question about Using AWS S3 in region "cn-northwest-1"(China) HOT 4
- ICE dashborad show wrong price HOT 2
- how to set Reserved Instance's Region? HOT 1
- How to set RI region?
- Can anyone explain what is "reservationUtilization=HEAVY" and FIXED? HOT 1
- Do ice support https? HOT 1
- How to change default listen url: http://localhost:8080/${appName}? HOT 2
- What does Usage mean on ice dashboard? HOT 3
- Any plan migrate from Detailed Billing Reports to Cost and Usage Reports? HOT 3
- ProcessorConfig.getAccountsFromOrganizations error in jimroth/ice fork
- Failed to parse billing file HOT 3
- ERROR BootStrap - Startup failed when running docker-compose up
- load AWS credentials from any provider in the chain HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from ice.