2.24 notes

Post any software related questions or comments here. This is also the place to ask for help if you can't figure out how to do something in Wave59.
User avatar
Feinberg
Posts: 54
Joined: Wed Jul 22, 2015 10:18 pm
Contact:

Re: 2.24 notes

Post by Feinberg » Sat Mar 19, 2016 6:40 pm

Thank you Earik!

The "movie" was right there in front of me to see, posted above, and so were your explanations. :oops:

Thank you for providing us with this valuable Order Flow Module.

And thank you too for making these corrections/updates/fixes with the Cumulative Volume's display and presentation! :D

In this chart, I have colored the Cumulative Volume Bars in black, and yesterday, Friday, March 18th, there was a non-confirmation around 3:00 pm Eastern ( 4minute, @esm16).

The Cumulative Volume was making a double bottom with the level that is was at about 1:30 pm, but prices were making a higher High.

With gratitude for these module features and your efforts,

Joseph
Attachments
OrderFlow_160318a.JPG
OrderFlow_160318a.JPG (146.07 KiB) Viewed 6168 times

User avatar
Feinberg
Posts: 54
Joined: Wed Jul 22, 2015 10:18 pm
Contact:

Re: 2.24 notes

Post by Feinberg » Tue Mar 22, 2016 6:50 pm

Earik,

The Cumulative Volume is still not displaying correctly.

Both 24 hour charts are 4 minute bars of the e-mini taken today, Tuesday, March 22nd.

The "a" chart was started about 8:30 am Eastern and IQ Collector was kept running in the background.

At about 12:30 pm, I closed Wave59, recollected the data, and then re-opened Wave59 and my chart, the "c" chart. You can see the difference in the volume patterns. It still needs attention.

I was testing this on my new Windows 10 machine.

Joseph
Attachments
Volume_130322a.jpg
Volume_130322a.jpg (18.18 KiB) Viewed 6147 times
Volume_130322c.jpg
Volume_130322c.jpg (21.19 KiB) Viewed 6147 times

User avatar
earik
Site Admin
Posts: 474
Joined: Mon Dec 01, 2014 12:41 pm
Contact:

Re: 2.24 notes

Post by earik » Wed Mar 23, 2016 5:26 pm

Hi Joseph,

Make sure you are running the most up-to-date version of IQC. I forgot to update the version number last time (whoops :oops: ), so I've attached the latest to this post just to be sure. Download, unzip, then overwrite your current one. This takes advantage of IQFeed's most recent protocols, which include microsecond timestamps, which are important.

Just to give you an idea what's going on here... This isn't really an issue of a bug in the sense that I made a programming error somewhere. It's more an issue in dealing with a really tricky problem. The CME doesn't release bid/ask/trade values together. They have two data feeds - one for trades, and the other for bid/ask. These go to DTN on two separate lines, and then DTN merges them together. IQCollector needs to know when a trade happens at the bid or the ask, but since the data is split up, it's impossible to really know and you have to work backwards. There are time stamps on everything, so if you build it up after the fact this is no big deal (like when you download history), but doing it in real time is more difficult because you can (and do!) experience latency on one or both of those data streams from time to time. So you can get a trade value, but then have to wait to figure out what the actual bid/ask was at the time. But if you wait, then your charting program doesn't get updates on time, and there's a whole latency issue that can pop up. I've spoken with the programmers at IQ about it, and we all basically agree that the whole thing is a PITA, with no easy workaround.

Having said that, I'm still trying to get it better. But it's just not so easy.

Anyway, all for now. Make sure you're up to date with the current IQC, and see if that helps at all.

Earik
Attachments
IQ_Collector.zip
(2.99 MiB) Downloaded 283 times

User avatar
Feinberg
Posts: 54
Joined: Wed Jul 22, 2015 10:18 pm
Contact:

Re: 2.24 notes

Post by Feinberg » Thu Mar 24, 2016 1:24 pm

Thank you, Earik............ACKNOWLEDGEMENT :D

I appreciate your making available this new version and especially give us some insight as to the data delivery / data organization / programming difficulties.

I would consider this version an improvement. However, it is still not ready for real time trading.

The first chart "A", was taken at about 8:15 am this morning, Eastern time, Thursday, March 24th.

This is a 4 minute chart of the Cumulative Volume. I kept it running all morning long.

The second chart "B", was taken at about 1:15 pm just before I saved the charts and closed Wave59.

In the third chart "C", I kept the IQ Collector running in the background and just re-opened Wave59. Chart "B" an Chart "C" look this same.

But here is the snafu...........

In chart "D", I closed Wave 59, then I closed IQ Collector. My next step was to re=Collect the entire series for today, and ore-open Wave59 and my charts.

YOU WILL NOTICE A BIG DIFFERENCE IN THE PATTERN OF CHART "D" COMPARED TO THE PATTERN IN CHARTS "B" AND "C".

SO WHAT IS STILL REQUIRED OF US IS TO CONSTANTLY RE-COLLECT THE DATA. :x :shock:

I will say, as is, this did help me. I was looking for the relative Cumulative Volume pattern and its relation to price.

BUT IT IS NOT READY YET TO TRADE WITH.

I know you are doing your best at this, and I thank you. But I am wondering if we, the Wave59 members, aught to engaged in a public relations campaign with DTN-IQ Feed 's management to suggest,

1) An interest in providing these data features, and

2) Greater fluidity in the transmission of the data feeds to us as customers.

It is preposterous for the CME to send two data streams to DTN, DTN "bundles" both fees into one and sends it to us, and then you as a programmer / developer / entrepreneur have to separate the data into two separate streams?

Joseph
Attachments
Cumulative Volume_160324a.jpg
Cumulative Volume_160324a.jpg (21.46 KiB) Viewed 6104 times
Cumulative Volume_160324b.jpg
Cumulative Volume_160324b.jpg (22.5 KiB) Viewed 6104 times
Cumulative Volume_160324c.jpg
Cumulative Volume_160324c.jpg (24.71 KiB) Viewed 6104 times
Cumulative Volume_160324d.jpg
Cumulative Volume_160324d.jpg (24.98 KiB) Viewed 6104 times

User avatar
earik
Site Admin
Posts: 474
Joined: Mon Dec 01, 2014 12:41 pm
Contact:

Re: 2.24 notes

Post by earik » Thu Mar 24, 2016 8:19 pm

I know you are doing your best at this, and I thank you. But I am wondering if we, the Wave59 members, aught to engaged in a public relations campaign with DTN-IQ Feed 's management to suggest,

1) An interest in providing these data features, and

2) Greater fluidity in the transmission of the data feeds to us as customers.

It is preposterous for the CME to send two data streams to DTN, DTN "bundles" both fees into one and sends it to us, and then you as a programmer / developer / entrepreneur have to separate the data into two separate streams?
hi Joseph,

It's not DTN's fault - this is the way the CME sends data. If you consider the bid/ask feed, it's probably 50x more information than the trade-by-trade feed. You don't want all those bids and asks to create a bottleneck in reporting actual trades, so they stuff the two down separate pipes. If the bid/ask gets crazy and has latency, then at least the trades are up-to-date and you know what prices are. Consider in light of a market crash, and it makes a lot of sense why to do it that way.

So getting on DTN's case about this isn't going to help matters, because they don't have the power to change it, and the CME has a good reason for doing it this way. The solution is for me to figure out a better way of putting humpty dumpty back together again after the fact, as obviously the way I'm doing it now isn't quite working out according to your charts.

Earik

ComGold
Posts: 6
Joined: Wed Feb 10, 2016 6:50 pm
Location: Sweden
Contact:

Re: 2.24 notes

Post by ComGold » Thu Mar 31, 2016 4:41 am

earik wrote:Hi Christer,

The data is stored in US Eastern Time format, but then gets converted to local time on the fly. Looks like it's having an issue knowing to grab from the previous day to get your first 6 hours. I'll check it out.
-snip-

Earik
Hello Earik,

Same problem is back with version 1.1. No data and no realtime data in OrderFlow chart before 06:00 CET. Chart starts updating at 06:00, but no data showing before 06:00.

//Christer

Post Reply

Who is online

Users browsing this forum: No registered users and 107 guests