« first day (1016 days earlier)      last day (3947 days later) » 

9:00 PM
@Simon_eQ Well (assuming you don't try and run a desktop env/anything else graphically intense), your VM will be fine with 512MB
Sorry for epic multiping
 
@Simon_eQ With only 2 GB, it's indeed likely to be a bottleneck, so you indeed want to run GUI-less and low on VM RAM
 
@DaveRandom so I should use 25 then to guarantee I will receive email?
 
Is it virtualbox that does the thing where you can get it to burst the ram for swap? I remember I set that up once (it might have been vmware) and it ate all my system ram very quickly
@crypticツ What are you doing? Setting up a relay on your server?
 
Anonymous
Trust me. I have killed all GUI applications. went to msconfig and removed some services. It feels like I am running my pc from safemode though. I will try and see what happens tonight
 
I'm running Ubuntu right now on Win7, virtualised :)
VMWare Player (Y)
Out of 8GB RAM, I have 3 left
So we're talking 5GB for Ubuntu + Win7
 
Anonymous
9:05 PM
@Jimbo any reason why Ubuntu over CentOS?
 
@Jimbo Yeh but do you have a GPU?
 
@Simon_eQ Yeah, never tried CentOS, and Ubuntu is everything i'd ever need. Think of it this way. If you have a problem with linux, what are you more likely to find a solution for after a quick google search? CentOS, or Ubuntu?
 
0
A: PHP function to open database using PDO

Madara UchihaFirst off, let me congratulate you for making the effort to learn PDO over mysql_*. You're ahead of the curve! Now, a few things to understand: PDO is OO, meaning the connection to the database is represented by a PDO Object. Your db_connect() function should return the object that gets create...

 
@DaveRandom dedicating a server to just handle mail. Want to be able to send and receive email for multiple domains. I need to host a mailman list which will be hosted on the webserver which will get emails from the mailserver.
 
Anything to add? :) (Feel free to edit)
 
9:06 PM
@DaveRandom GTX 780 as of last Friday ;)
 
@Jimbo Congrats :D
 
@Jimbo Yeh see all your graphics for the guest are offloaded to that as well, it makes it much slicker
 
@Simon_eQ The key isn't doing shutting things off in Windows, but in linux not to run any virtual environment (desktop environment) and give it little RAM, because it need ltitle RAM
 
But my piece of crap laptop on the other hand... no.
 
Anonymous
9:08 PM
@Jimbo Judging by your analogy, you would also choose apache over nginx ... not cool
 
@Simon_eQ In my experience, Debian is really good for web servers. RHEL (or CentOS) is good for most everything else server related.
And RHEL and CentOS are awful when it comes to being user friendly. Debian and children are much better.
 
@Simon_eQ Also true :P Although I know nginx has a much lower resource footprint - but that doesn't matter to me
 
@DaveRandom I don't think that's VirtualBox (that is to say, I can't find the option in its GUI)
 
@Jimbo That and it is faster and it is nicer to configure
 
@PeeHaa But does it do all the apache stuff? So all the popular mods, rewrite, geoip etc, and htaccess stuff?
 
9:10 PM
@Jimbo no it doesn't
 
@crypticツ Firstly, have you confirmed that the hosting platform will let you do that? Because many won't. And secondly, with the greatest of respect, hire somebody to set it up for you (and no, that somebody is not me). Mail servers are a serious, serious pain in the arse to set up, and a humongous swiss-cheese of security problems. There are people who dedicate their entire careers to managing email.
 
And for most stuff with good reason ;)
 
@Jimbo I run the two in < 4 GB and that's including bloated overusing GUI on Ubuntu
 
@PeeHaa Rewrite is still possible though.
 
yep
 
9:11 PM
@jimbo GeoIP is there, but needs a recompile - wiki.nginx.org/HttpGeoipModule
 
Anonymous
@LeviMorrison I'm hoping to run a server by it. So, CentOS is the best option I have. I just hope it wont take too long to learn the basics ..
 
And it does rewrite properly, and htaccess is dumb, so it doesn't do that.
 
@Simon_eQ What kind of server? Mail? HTTP? Mix?
 
Hmm, I do need to check nginx ('en-jinks' as I used to pronounce it lol)
 
@DaveRandom Ow boy was I happy with my simple install all-in-wonder-resource-hungry-solution-but-it-just-works mail setup :P
 
Anonymous
9:13 PM
@LeviMorrison HTTP.
 
@Jimbo Engine X :)
 
@Jasper Yeh I think it might have been an experimental feature in the previous VMWare free thing (I forget what it was called right now)
 
@LeviMorrison I know I know :P
 
I've never heard anyone say it "Engine X", honestly. No wonder they amended their homepage to include a pronunciation guide :)
 
@PeeHaa That's one of a few things in life that experience tells me "just pay someone to do it, it's quicker, safer and in the long run probably cheaper". Like wallpapering, plumbing and plastering. I can do all of them but I'm shit at all of them.
 
9:15 PM
@DaveRandom I'm pretty happy with zimbra. But as stated in eats your machine
java
 
Java itself is not a resource hog; it's programs that don't understand or care about performance that give it that stigma.
 
Trusting Java to guard something notoriously insecure by design? :-S
 
Lets just say that when I have 100 java applications and 99% of them are slow I say java applications are slow.
 
You can say the same about PHP, except in the case of PHP the language is slow.
 
@DaveRandom Why? Does java have a bad track record?
:D
 
9:16 PM
I think the problem is more that (most) Java developers are slow (in the head)
7
 
lol @ 2x
 
PHP is horribly, horribly slow for a modern language. It was fine when PHP 5.0 was created but there have been so many advanced techniques that other languages have that have not been ported to PHP.
I've been learning a lot about VM optimization.
Hopefully some day I will help port theses techniques to PHP, but for now I'm still underskilled with too many demands on my time to make it happen.
 
@DaveRandom PHP developers can't program properly, Java programmers are slow. It's all the programmers' faults, not the languages'.
 
It's less Java's fault that Java applications are bad than it is PHP's fault that PHP applications are bad
 
can i run sql command in phpmyadmin to import a sql file from some location like http: / / foo.com/file.sql ?
 
9:23 PM
@silverflash No, but that would be a terrible idea anyway
 
My server doesnot allow importing large sql files through phpmyadmin :(
 
So break it up a bit then, just create a set of smaller files
Or ask the sysadmin to do it for you
 
@DaveRandom Doesn't phpMyAdmin have functyionality to do that for you?
 
Most likely the problem is simply max upload size
@Jasper I imagine so, I don't use it very much any more, can't really remember :-P
 
Can phpmyadmin break file into small parts automatically ?
 
9:26 PM
@silverflash What would be the benefit of doing it from a url be compared to downloading the file and uploading it to phpMyAdmin?
 
user895378
@LeviMorrison Regarding the Ardent name collision ... I wouldn't worry about some garbage ORM addon for a garbage framework (Laravel) written in a garbage language (PHP). People using that crap wouldn't have any idea what to do with your library anyway. I'd say the issue you reported to their tracker is enough.
 
Have a look at the export options. but you would have to do it at export time, you can't do it at import
 
@DaveRandom I can do it on the host. Yeah it seems like a daunting task, I'm going to give it a shot, if it doesn't work though will get rid of the server and try a paid email service. Which doesn't sound like such a bad idea. I honestly don't want to have to maintain a mailserver.
 
@Jasper Nothing, just a bad random thought :(
 
@silverflash PHpMyAdmin has "Partial Import:" for if the problem is php execution time
If the upload file size is the problem, it also supports compression, so that might be a solution
 
user895378
9:29 PM
Also, aerys now officially retains response header casing. Turns out strpos/stripos/substr combos with strings are much faster than array maps for the purposes for which I was using them.
 
@rdlowrey yay!
 
user895378
@PeeHaa Yes, I knew that would make you and @DaveRandom happy :)
 
@rdlowrey Yeh I recall reading something to that effect once, it's related to the swiss-army knife nature of PHP arrays, because you can do so much with them certain kinds of access are slooooow.
Also +1 :-P
 
@Jasper Yes, it has. But, my sql file is 80Mb and it allows files in chunks of 2Mbs. I will die doing that :(
 
user895378
It's crazy that you can just concatenate and substr() and stri?pos() things all over and it can be faster than isset($headers['CONTENT-LENGTH']) (for example), but whatever ... I guess it makes sense with as much hashing as PHP does to make arrays work as maps.
 
9:34 PM
How can I connect to remote sql server from command line on windows ?
 
@silverflash php execution time isn't measured in MBs, so I have a feeling that might not be your problem
sounds like you might want your sys admin to do this for you (as @DaveRandom suggested). You could also look into changing your php settings if you have access to those
 
@rdlowrey I did wonder if there might be something you could do with the \x20 trick, maybe something like if ((($aShitLoadOfSpaces & $var) | $var) === 'lower-case-header-name')
It's a bit ugly though
 
I tried adding these php_value upload_max_filesize 80M
php_value post_max_size 80M
php_value max_execution_time 300
php_value max_input_time 300 But did not work
@Jasper How can I connect to sql server via command line ?
 
@silverflash Those settings aren't changable via htaccess iirc
 
@DaveRandom Then ?
 
9:38 PM
Your sysadmin would have to do it for you
@silverflash rtfm ;-)
 
@DaveRandom I have no sysadmin :( I am working on someones machine from home
 
user895378
@DaveRandom Well I cobbled together a few things. For one, headers are now only automatically normalized/corrected/assigned for you just before the message is sent to the client. Before it could potentially happen multiple times. As for determining if headers exist and what their values are ... simply storing all the assigned headers in a single string and running stripos/strpos/substr turns out to be quite fast.
 
user895378
I may still try to do something with the \x20 trick but at least now headers are assigned by handlers in a way that would allow that to happen.
 
@silverflash ssh to your server (if you have that access to that, assuming it is a linux server) or install the the mysql client (though it's likely mysql is configured not to allow external connections)
sorry for the misping
 
@rdlowrey Got some new performance numbers for us yet?
 
9:43 PM
@Jasper yep, mysql is not taking external connections
 
@silverflash Then you'll need access to the server (e.g. ssh) or you're out of luck
 
user895378
@LeviMorrison Well they aren't that exciting ... just up to around ~7200 responses per second where before I had dropped down to ~6700. If some of the memory leaks that happen with Ev extension are fixed that could potentially provide a significant speed bost for *nix users. I am also about to embark on a rewrite of the Amp\LibeventReactor with the goal being to maximize its speed -- that will also hopefully result in big speed boost across operating systems. (sorry for mega ultra super ping)
 
@Jasper I have got a telnet :P .... not SSH .... :P (I don't want to live in this world anymore !)
 
@silverflash I have never worked with telnet, so I have 0 idea what you can and can't do with it
 
hey, how to reduce the video quality using php?
 
user895378
9:46 PM
I haven't really spent much (any?) time optimizing the reactor code to this point, and it's basically the engine that underlies the whole server. So I'm crossing my fingers that doing so will mean a big performance gain in the server.
 
@DaveRandom According to the docs, all of them are
 
@rdlowrey We should do a skype call sometime.
I can't believe we haven't collaborated a bit more than just SO chat :)
 
user895378
Well I don't have much to talk about ... better at writing code than talking about writing code :)
 
@rdlowrey a couple of cursory tests suggest that the bitwise approach is quite a bit quicker than strtolower(), although after the results this machine was giving me yesterday with gmdate() I'm not sure I trust this machine for benchmarking
 
9:52 PM
@Jasper I have ssh access also now. Can I dump sql file on server and do something to import it ?
 
It does have a serious drawback though: your string of spaces must be as long or longer than the subject string. Which makes it somewhat impractical when dealing with user input.
 
@silverflash you can use SCP to get the file onto the server, and use some mysql command to import the file (I have no idea what command, but a little googling will probably hold the answer to that question)
 
user895378
@DaveRandom Well for my purposes you're only dealing with response headers generated by the application, so there shouldn't ever be an issue with too much memory unless you're seriously doing it wrong.
 
BTW @rdlowrey Artax is fucking awesome. tnx!
 
@rdlowrey I guess it's not really a problem actually, you know how long the longest header you look for is, it doesn't really matter if some user defines their own longer header name because you're not looking for it. Just predefine a long enough string of spaces. Although obviously you couldn't wrap that in a function as you'd instantly lose any gain you'd get from it :-(
Aerys seems to be rapidly turning into a lesson in how not to write a PHP application
 
user895378
10:00 PM
@PeeHaa cool! Glad it helped you. When I have some time I have some things I'd like to improve regarding how extensions work. Otherwise I'm pretty pleased with it.
 
user895378
@DaveRandom What? You don't like goto parsing routines? ;p
 
user895378
goto_all_of_the_things.jpg
 
start:
while (1) goto start;
 
user895378
start: { while (1) goto start; } // One-line FTW
 
Or the Futurama classic:
10: HOME
20: SWEET
30: GOTO 10
 
10:04 PM
@rdlowrey start: { while (1) goto start; collect(200)}
 
user895378
Oh, back to back Futurama and Monopoly references. If someone can squeeze in a Game of Thrones or Doctor Who reference I might explode.
 
I still haven't watched any of GoT, I have it all on my TV computer but I don't have the time to get into something else, I've got enough to catch up on as it is
I still haven't watched 24 S8
 
is there any player like jwplayer where i can adjust the video bit rate?
 
@NokImchen the bitrate is normally in the video, not in the player
 
@NokImchen That's actually not feasible, to change the bitrate that you would have to re-encode the video server side
 
10:10 PM
@hakre yes, but i'd like the player to have option to reduce the bit rate like youtube
 
and that's cpu-intensive and AFAIK, not easy to do
@NokImchen youtube does re-encode to several bitrates on upload
 
@Jasper i have shared hosting account, so, using php, re-encoding the video seems not possible, is it possible?
 
@NokImchen youtube doesnt do that on the fly :P
 
@NokImchen blog.wikimedia.org/2012/11/08/… - it's all open. The also have a list somewhere of more developer resources. AFAIK the most comprehensive listing so far online.
 
@Jasper i dont know abt youtube re-encode, but i like their various bit rate options, it helps to video video in low bandwidth users
 
10:12 PM
@NokImchen ffmpeg is what you need
have fun
 
No idea if they have something to switch formats so far.
@NokImchen they have different versions pre-made on youtube.
 
@NokImchen Due to Turing-completeness it's probably possible, but it may be really hard / a lot of work. Even if you get it done,t hough, your shared host will probably get angry at you about the amount of CPU you use
 
you can learn more about that with a software called youtube-dl.
 
@PeeHaa but, it seems youtube can do it on fly! cos as soon as i click the 240bp, the video streams at 240bp
 
@NokImchen not on the fly: rg3.github.io/youtube-dl
 
10:13 PM
@NokImchen They pre-encode all videos...
 
@hakre oh, i didn't know that!!!! they must be consuming a lot of hard disk!!!
 
@NokImchen it jsut switches which video file it is using (and is smart about it, considering it starts at the same point, which is possible because the different files represent the same movie)
 
Who would have thought ;)
 
@NokImchen it's their hobby to consume harddisk space, so sure they do!
 
@PeeHaa but ffmpeg will take more than a min to re-encode a 2 GB video :(,
 
10:14 PM
Your point?
 
@NokImchen most certainly a little more than a min, yes yes. Sniff.
 
@hakre hehehe, my hobby too :D my db is almost 10 GB :D
 
@NokImchen I'm sorry, what???
 
@NokImchen well add some zeroes to that at the end ...
 
You really need to learn more about how media encoding and stream composition works if you think that is possible without a supercomputer
 
10:15 PM
@hakre 10 GD for shared hosting is a lot :|
 
Just grab the binary data of the video and divide it by 2 to get a lower bitrate :D
2
 
@NokImchen What are you trying to achieve? If the videos are static (you upload them manually and not through some web interface of your website) you might be able to achieve what you want be encoding different bitrates before uploading
 
@PeeHaa lulz
 
@DaveRandom yup! i have NO idea abt videos. I'll have to google a lot.
 
I highly recommend getting to grips with the Gordian Knot rip pack if you really want to know about it. But I can also tell you that unless you are a monumentally dull person, you don't want to know about it.
 
10:17 PM
@DaveRandom hehe
 
I don't know that much but I still know way too much for my liking
 
@Jasper nope, i'm downloading like a 2GB movie using multi_curl. And trying to re-encode it to like 300 MB low quality video so that i can watch it streaming :)
 
Can anyone try this website and give me feedback about looks, performance and anything else ? mp3fury.net84.net It works on some new algorithms that I have developed and I am presenting it with my research paper tomorrow. Just want to know general reaction. Its a prototype not a product.
 
@PeeHaa No. Its a prototype
Not a product.
 
10:18 PM
:|
 
And your point is...?
 
@PeeHaa how did u get that exploit so quickly??
 
Because it's in the first 2 things any of us would try
 
It's not like he made it hard :P
 
(the other being ' OR '1' = '1)
 
10:19 PM
@silverflash partial matches seem a bit strange if you ask me (e.g. finding "black" when I search for "bla")
 
@silverflash it does not work with scripts disabled.
 
@Jasper Meaning ?
 
Oh I smell magic quotes as well
 
@hakre omg! really great link!! so they also keep pre-encoded videos of 360p, 478p, ??
 
10:21 PM
@NokImchen I dunno. Just dig in there, I guess it's worth to do so.
 
@silverflash that when I search "black" I don't expect to find "blackmail", which has very little to do with the color
 
@hakre yup, really great player commons.wikimedia.org/wiki/File:Puerto_del_Rosario_-Tefia-La_Alcogida-_dromedary_%28oT%29_01.ogv?embedplayer=yes
 
@Jasper Also tell me about security flaws :(
@PeeHaa Please tell me about security flaws
 
@silverflash You mean that huge gaping sql injection hole or the xss one?
 
@PeeHaa Yes. But in private.
 
10:25 PM
@NokImchen It would be stupid to do it any other way. The amount of CPU time required to realtime recode videos on the fly is considerable, the amount of HDD space it takes up costs cents (or less).
 
hmm at least you don't store any user data
Not in the db at least
 
@PeeHaa :)
 
@silverflash: Before putting that stuff online, do yourself a favor and let it review by someone. you get an report and you can discuss where you made mistakes so you can prevent them in the future.
 
I smell two tables: movie_names and song_names
 
@silverflash Aren't you concerned that he knows that you don't store any user data in the DB? That means that he knows what you do store in the DB...
 
10:26 PM
@silverflash Please read this: stackoverflow.com/questions/60174/…
 
@DaveRandom ah, i'll search for re-encoding using php and save it in server. is it possible to re-encode part by part 'cos the video i like 2Gb (i guess, its too large to handle in godaddy shared account)
 
@PeeHaa How you did that ??
 
@NokImchen ffmpeg is really the only viable tool if you're using PHP and you don't know a lot about video
 
@PeeHaa There are total of 8 tables. Let see if you find other secure once.
 
@silverflash That is what happens if you don't sanitize your input
 
10:29 PM
The one connected to interface are not properly filtered :(
 
@DaveRandom yup, i'm in download page thud.us/videos/misc/nature-raptor-force.avi I have no idea how to download :|
 
All I'm saying is: mp3fury.net84.net/…
And that concludes my free security consult
 
@PeeHaa Got it. What about a paid teaching ?
 
You are running on 000webhost. So nuff said I think
 
@DaveRandom is it possible to use ffmpeg in godaddy shared linux account?
 
10:33 PM
@NokImchen probably it's not enabled on any shared hosting - it simply uses too much cpu for shared hosting
 
You would have to ask godaddy
 
@PeeHaa Why would some give link to his own server ? with a crappy website ?
 
@NokImchen I don't think he is from godaddy support, but godaddy offers support, you only need to mail / phone them.
 
I don't use shit hosts ;-)
 
:P
 
10:34 PM
@DaveRandom I always use them for testing.
 
@hakre godddy suppport is too bad. i regret y i left hostgator. cos hostgator support is instant. while godaddy support take 24 hours!!!!
 
^ while we're at it, just burn it :D
 
@NokImchen It's probably possible using a (cheap) VPS, but you won't get a lot of CPU power cheaply, so it would take long
 
Gah, integrating Auryn with Silex is harder than I thought
 
@Jimbo Oh No!
 
10:35 PM
This is the optimum time for creativity, 11:30pm for me
 
hmm, optimum time for creativity for me is around 2:34AM
 
@Jasper ya, i'll be trying vps after i get a day-job :|
 
optimum time to quit using keyboard for me is now.
 
@Jimbo Are you that perfect amount of drunk?
 
cu tomorrow folks.
 
10:37 PM
later @hakre
 
@hakre gooodnight :) sdz :) tc :)
@hakre thanks for helping everyday :)
 
@DaveRandom Nah - okay so optimum time plus optimum alchol = optimum creativity then
 
Its time I should read about IT security ? Any resources ? Books ?
 
@NokImchen VPSes don't have to be more expensive than shared hosting (lowendbox.com)
 
I've said optimum too many times it looks wrong now, maybe optimal.. whatever
 
10:38 PM
 
@silverflash for starters check out htmlentities and ->real_escape_string/prepare, for xss and sql injection :D
 
@Jasper i have an ATM cum Debit Card (mastero), but i have no credit card yet :(
 
@NokImchen Most providers accept paypal, so that could be a solution
 
@Jasper i'm still wondering how to make that 2 GB video to 300 MB video so that i can watch a movie tonight :D
 
10:40 PM
@NokImchen Why can't you just download 2GB?
 
@Jasper paypal is another big headache!!! they want all document like Driving license, Electricty Bill, PAN Card, etc etc... its same as opening an bank account!!!!
 
@PeeHaa Any books ? I am more comfortable reading books. Plus, my employers pays for my books :P
 
dunno
 
@Jasper 2GB will take like 12 hours to download! btw, its not abt a movie, i want to see movie dailly by downloading from putlocker.com into my server :)
 
@NokImchen I've never had any trouble with that, I've made an account without showing them anything basically, and linking it to my bank account was as easy as identifying a message they sent me with a $0.01 transaction
 
10:42 PM
download from putlocker ==>>re-encode into 300 MB ===>>use jwplayer ==>>watch movie dail :D
 
@NokImchen Getting this to work will take longer. Just make sure you start your download long enough ahead of time...
 
@NokImchen Never had that (I'm in Canada! :D), banks are a bit slower, but yeah they send you a few cents, you confirm the amount they sent, and then it's all okay.
 
@Jasper yup. but here in India, the govt is damn strict! Have to go through a lot of formalities to avoid terrorist activities :( *they dont knw that i'm an angle :P *
 
@NokImchen obtuse or acute?
 
@DaveChen canada!!!! i love it! i wish i'm an canadian so that i can trade spot FOREX!!!
 
10:45 PM
(sorry, that's a lame joke)
 
I'm acute angel
 
haha nah it was pretty good :P
 
@Jasper both :|
 
@DaveRandom lol
 
good for people's security, but it makes everything slow :(
acute?
ohoh, acute|obtuse => actually
my typo, sorry :( dont make fun anymore :'(
 
10:47 PM
@NokImchen acute and obtuse are types of geometrical angles
 
@Jasper acute angel? <90 degree? ah!!! angel or angle? :|
 
@Jasper Don't worry, it was just a reflex
Yay bad pun contests
 
@DaveRandom clever
 
anyone know any site that has remote video upload features and also with multiple bitrate streaming option?
 
@NokImchen Which movie ??
 
10:54 PM
lolzzz, veevr.com/upload is my solution!!!!
 
I can download, convert and send :)
 
@silverflash almost all movies!! i want to watch movies daily by streaming... so there is no specific movie
 
@NokImchen One of my friend does this : get many free hosting accounts. Write script to download movies to them and convert them on server and then you can see
 
@NokImchen I couldn't quickly find whether the site allows private videos and how they treat copyright issues on such private videos, but it is something to watch out for
 
This works ... you can get 4 GB movie in 700 Mb
Why dont you use torrents ?
 
10:57 PM
File size means nothing
You can compress 10 hours of video into a 100MB file if you really want to
 
Ok. Copyright ???
 
@Jasper i have no copyright over any movie!!! :| but they do provide a privet setting so i'm not gonna distribute the movie to anyone.
 
In fact, you can actually do that still retain a watchable quality level
 
@NokImchen so does youtube, but they seem to ban accounts on copyright violations on private videos anyway
 
@silverflash script is the prob!!! i cant get the script to work in godaddy shred account :(
 
10:59 PM
I did a whole bunch of work on this kind of thing a couple of years ago, it's amazing what you can acheive by stripping out keyframes, but you lose error correction when you do
 
@NokImchen What do you want to do with script ?
 
@Jasper ban account even for private videos?? too bad :(
 
@DaveRandom keyframes? A key frame in animation and filmmaking is a drawing that defines the starting and ending points of any smooth transition understood nothing :|
@silverflash to reduce to bit rate from 730p to 320p
 
@NokImchen ever used vlc?
 
11:02 PM
@Jasper always! using it for more than 7 yrs!
 
Essentially (and this is a very loose explanation that leaves a lot out and isn't 100% true, but it gives the basic idea): Imagine a video is simply a collection of still images, which are cycled very quickly (i.e. frames). Now, most of the time in your average bit of video, only a relatively small area of the screen is subject to change between two consecutive frames.
 
@NokImchen ever noticed that it sometimes draws the changes in the scene as on top of the previous scene?
 
So rather than embedding each frame as a complete image into the video, you can save space by storing a single image at the beginning of a sequence, and simply tracking the changes from one frame to the next
 
@Jasper yup, on bad quality videos!
 
@NokImchen That happens when it skipped a key frame (if I'm not mistaken, but I'm not 100% sure, either way, it does help in understanding what key frames are)
 
11:04 PM
@DaveRandom yup exactly! thats what mpeg encoding means, right??
 
In theory, it's possible to have a single key frame at the beginning of a video and just track the changes all the way through. But when you do that you have no error correction at all
 
@Gordon it wasn't a recruiter... It was the company itself...
 
@NokImchen It's one of the things that an mpeg stream does, but it does many other things as well
 
@DaveRandom oh, it will be too bad to watch such video, especially if the scene happens to be an important scene!!! i'll end up throwing away my monitor before i finish the movie :P
 
If you really want to know about this kind of stuff, I recommend you first go and learn about differences between a stream and a container, then learn about about the differences between various containers, and only once you understand all that should you start trying to understand how streams and encoding work
 
11:06 PM
btw, veevr.com/my/videos has a remote upload speed of ~5MB/s!!! atleast 50x better than godaddy!!! But veevr.com/my/videos dont provide the bitrate option :(
@DaveRandom oh, just to watch movies, i dont wanna learn all these from scratch :(
 
@NokImchen Yeh, it's no good for streaming because you have zero jitter buffer. But if you are going to add an artificial buffer layer over the stream you can acheive some pretty amazing things bandwidth-wise
It's considerably more computationally expensive to encode though
 
@DaveRandom well, my stupid thought, is it possible to device an lossess algorithm to compress 1Gb into 1KB? like, if 1st compress achieves 10%, then 2nd compress 10% and so on, till it reach 1 KB :P
 
No, and if you think about that question for a second you'll realise why :-P
 
@NokImchen 1GB of zeroes, sure. But other than that... no
 
lol ^^
 
11:11 PM
@Jasper zeros?? lolzzz, i think its possible, like a massive star can be compress into a black hole
@DaveRandom well, see, using zip, we'll compress. Then using an algorighm, we can change the binary code in such a way that if we compress the 1st zip, i'll further compress... i have already tried the trick i converted the reversed the double digit ascii number like 65 into 56. I did work a bit (not sure, i did it a month agao)
 
@NokImchen The idea of a good compression algorithm is that it already does such tricks, until there isn't any more to be gained without losing information
 
Again, I think you need to learn how compression algorithms work in the general case ;-)
 
@jasper with rle you can achieve that in 5 bytes ;)
 
I remember I had a packed version of GTA3 on PC years ago that somehow had compressed the whole game (about 1.5GB) into a 130MB file with a self extractor, I periodically wonder how the hell they did that
 
11:15 PM
@DaveRandom i did a lot of google search and stackoverflow searches. And finally, i decided to write my own algo. like ascii 216 can be written as 63 means 6^3, thus we can save 1 digit
 
@NokImchen Computers don't work in ASCII ;-)
 
@Danack pigeon-hole principle i love this, it proved that there are 100s of ppl who have same number of hairs like u do :P
 
Text compression is very very easy
 
@DaveRandom yup, but it work like this (not sure), binary=>ascii=>chr
 
Or really anything where the entropy is <128
 
11:18 PM
@DaveRandom means?
 
@Orangepill which is a good point to start learning about lossless general purpose compression, especially if one's unclear about the answer to the 1 GB -> 1 kB question. The next thing would probably be that tree-thingy (forgot the name)
@DaveRandom I remember that. Not sure how they did that either
 
@NokImchen Meaning that a byte (8 bits) has 256 possible values (0-255) so if the set of possible values you are encoding is 128 possible values or less, you can simply drop a bit and shift bits from the next byte into the previous.
In a nutshell, the opposite approach to base64 encoding
 
@DaveRandom u r a genuis and i'm dull. just not going anything into my brain which has technical terms. i understand only layman's term :|
 
PHP has an answer for everything: php.net/manual/en/function.array-pad.php
 
@NokImchen It's not that complex. It's actually quite easy to visualise I think, hang on a second
 
11:23 PM
@PeeHaa :O
 
@DaveRandom actually, my idea, (which never worked) was like this if ascii values are 9,30,217 then we can write it as 131 thus instead of using 3 bytes, we'll need only 1 byte
 
@NokImchen that looks like 4 random numbers to me. You do need to explain how you get to the fourth number from the first three for that sentence to have any meaning
 
@Jasper oops!!! wrong example!! actually, its like 131 means 2^3+*1*,3^+*3*,6^3+*1* = 9,30,217 but its wrong!!
@Jasper what i want is to let a bunch of mathematicians work on it ... to write the numbers in condensed form like cube root or etc... so that big numbers can be made to smaller ones.. * may b i'm just dreaming! *
 
@NokImchen Take a look at pastebin.com/MhJnAvfh - in the top version, you'll notice the the most significant bit (the left hand side) of every byte is effectively unused, it doesn't carry any meaningful information for a standard ASCII character. So in the second version, we shift the next character into that bit, and things immediately only take up 7/8ths of the space they previously did
 
@NokImchen the things is, they give up granularity to do so. You can't do that in compression, because otherwise you might be losing essential data.
 
11:33 PM
That's about as simple as compression gets, but it is technically compression
"real" compression employs techniques like looking for repeated patterns in the data, so you can store that data only once and place pointers to the literal data throughout the stream
 
@Jasper yup, essential data as well as useless data , both needs to be preserved!
 
@DaveRandom I find rle easier and better describing what compression is about :P
 
@DaveRandom ya, that's kinda easy :P
@DaveRandom i'm still lost :| is that compression of two letters XX ?? :|
 
@NokImchen The bits marked with X are effectively unused
and the *** denotes the continuation of the sequence
 
@DaveRandom i better cry cos my poop head is too hard to get it :|
well, how come they byte 1 = "7 | 6 | 5 | 4 | 3 | 2 | 1 | 0"
 
11:38 PM
@Jasper RLE is quite application specific though, it only really works with certain kinds of data
(obviously :-P)
In computing, the most significant bit (msb or MSB, also called the high-order bit) is the bit position in a binary number having the greatest value. The msb is sometimes referred to as the left-most bit due to the convention in positional notation of writing more significant digits further to the left. The msb can also correspond to the sign bit of a signed binary number in one's or two's complement notation, "1" meaning negative and "0" meaning positive. It is common to assign each bit a position number, ranging from zero to N-1, where N is the number of bits in the binary representat...
 
ok, guys, no more lessons, u guys make a compression good enough to stream a movie of 1-3 GB though a 50kb internet connection :)
 
I find it easier to give bits with higher significance a high label, although annoyingly there are only really two possibilities for this and there is no convention :/
(at least, not across RFC authors)
 
@DaveRandom but that reflects the reality quite nicely, you need to watch out for not increasing size, you need more than one approach because your data may look differently, you need rather "smart" algorithms and so on. I also have a suggestion on what to do next, but I forgot the name of the algorithm
 
Yay it's alive!
 
sometimes i wonder, y do binary have to be only 1 and 0, y cant it be 0,1,2,3. Cos magnetic domain can have many directions...
 
11:42 PM
@Jasper Indeed, I'm just on a crawl-before-walking path here ;-)
 
@PeeHaa "File not found." Awesome!
 
I'm not talking about my main site. I'm talking about my server-performance-issue-monitor-coffee-machine-dishwasher
 
@NokImchen binary because that's what bi means. Why computers use binary is partially historic, but also because so many useful things can very easily and well defined represent two states
 
@PeeHaa Interesting. You're getting response times of <0.5ms? I need to get me one of them Dutch internet connections :-P
 
Ahh - I was going to ask 0.45 of a millsecond? i.e. 0.00045 of a second, that is very fast. But I guess is possible if it's on the same netwrok.
 
11:45 PM
@DaveRandom :D It's soeperfast
@Danack Neh "rounding issue" ;)
 
@Jasper yup, two stages: on "off* . But data is written in in magnetic domains? a domain can face many direction, but we can choose 4 distinct directions (north, south, east west). Thus, we can have quardnary instead of binary :P
 
Also it is milleseconds as you all can see. And not milliseconds so get off my back :D
 
@PeeHaa You know what they say "a miss is as good as a 'mille'."
 
@NokImchen It's just based on the flow of electrons at the moment, manipulating the electromagnetic properties of the transmission media is a bit beyond the scope of current commercial technology. But people are working on exactly that idea right at this instant, and I'm sure we will see that kind of thing becoming viable in the next 20 or so years
 
:P
 
11:49 PM
@NokImchen your computer uses a lot more than just that. It uses electric signals, it uses electron states (usb storage devices do anyway) and probably a bunch more that I don't know by heart. Boolean logic (and by extension math) also works quite well. And well, as I said, part of is historic - just how things happened to grow
@DaveRandom magnetic orientation is used in hdds, right? I think that's what he was referring to.
 
@Jasper yes! magnetic orientation!!!
i have just one dream, to compress the whole universe into a one MB!!! like Big Bang theory
 
@NokImchen Uhm yeah.
 
@Jasper IIRC that's exactly how double-density floppy disks worked
 
@DaveRandom btw, u seem to be having a lot of knowledge, y dont u make a artificial neural network to learn trading in financial market and earn a few billlion dollars :)
 
@NokImchen Isn't the big bang theory the other way around?
 
11:54 PM
I think this is a
 
@PeeHaa yup, 1 Mb => uncompress billion times ==> whole universe!!
 
1
Q: Detailed postage tracking

Actimeleim work on task to tracking USA mailboxes. All post services (ups, usps, fedex, dhl, etc) can track only their postages. And not all provide postage information (weight, recepient, sizes). How i can get this information from all services? May be some services provide it?

 
@DaveRandom floppy disks, diskettes and hard drives all worked on the same principles if I'm not mistaken
It wasn't until cds that we started going into different directions
but since then we have really been trying a lot of different techniques
 
@Jasper Well yeh :-P I just mean that's how they did the double density thing, by doubling the number of magnetic orientations that were used
 
@DaveRandom ah, yes. It's one of the other reasons we never moved away from binary,when we find a way to represent more states, we just represent more bits per "unit"
 
11:58 PM
tbh I'm currently more interested in hydrogen storage than data storage, that's where the real money will be when someone figures out how to do that in a safe (less explody) manner
 
haha
 
@DaveRandom "hydrogen storage" :O ?? kidding?
 

« first day (1016 days earlier)      last day (3947 days later) »