Google TV and Native Libraries

Software, ,

The Google TV runs a fairly unusual flavor of Android (at least the 2nd-gen ARM-based devices). I have a Sony Internet Player (not the Blu-Ray version), so what I’m about to write applies to that device, but maybe not any other, though it stands to reason that the other ARM-based GTVs are the same.

Phone-and-tablet Android doesn’t look much like a Linux desktop or server system. It uses the Linux kernel, to be sure, but a lot of the userspace libraries are custom. It even does not use Glibc, but a C library that Google wrote called Bionic. It’s fairly stripped down and lightweight, and while it implements most things you might need out of a standard libc, it does not pretend to be POSIX compliant.

Due to this, a Native Development Kit (NDK) is not yet available for the GTV. So the question remains: can we hack one together that works? The answer is… sorta.

From some simple investigation, I’ve learned that the Sony GTV is running a EGlibc 2.12.2, and probably a mostly-unmodified version of it. Someone with an @google.com email address stated that the reason for this was that they couldn’t get Chrome running against the Honeycomb version of Bionic.

With this knowledge in hand, I built a relatively standard arm-linux-gnueabi toolchain using crosstool-ng. Then I ‘adb pull’-ed the contents of /system/lib from my GTV and merged them with the new toolchain’s sysroot, copied some headers out of a stock NDK, and ended up with a sysroot that approximates what you’d find in platforms/ in a stock NDK, just without Bionic, and with EGlibc.

I didn’t get to modifying the NDK’s build system (it would need to be changed to find the new toolchain), so I built my native library manually, and got a simple “hello world” type app with a native lib. (It just calls a native method that returns a string, and displays the string on a label.)

One annoying thing is that the ABI string in the Sony GTV is set to “none”, so you have to unpack the APK, rename lib/armeabi-v7a/ to lib/none/, and repack and resign it. All of this means that this would be strictly hobbyist for now: no chance that you could distribute something in the Play Store. Not only does Google have to release an officially-working NDK, but they need to decide on an ABI string, and get Sony (etc.) to push updates out to their customers that update build.prop on the devices with the new ABI string.

There’s also the possibility that Google doesn’t want to create and officially support that much native drift between phone-and-tablet Android and GTV Android, and will wait until manufacturers are running a more-stock Android 4.x on GTV (that uses the 4.x version of Bionic) before releasing an NDK that works… in which case we’re at the mercy of Sony for updates, unless XDA or CyanogenMod wants to take a crack at it. My money’s on this scenario, unfortunately.

One of the main things people have been screaming for is a version of XBMC that runs on GTV. I have been able to get it to build using my hacked-together toolchain, but not actually to run. I ran into problems with runtime linking: the built binaries depend on a shared libstdc++ and libgcc_s, neither of which appear to be included on the GTV’s filesystem. I tried including them in the APK, but, weirdly, when the GTV unpacks the native libs from the APK at install time, it discards those two libraries. Static linking of those two may not be possible since XBMC’s APK includes a bunch of native libs. A possible solution would be to build all of libxbmc.so’s dependencies as static libs, and then just make one big static library.

But I haven’t had time to work on this over the past couple weeks…

Vim and Vala

Tips, Xfce
I once wrote a quick note about Vala and Vim (or Vim and Vala) and the use of the Tag List plugin. Here is a clean post about these two beasts.

Vim — probably the best editor out there, at least always after trying out different editors I end up with Vim — has great plugins. However there is a lack of support for the Vala language. So here are two basic add-ins to include in the Vim editor.

Vala syntax

First there is no syntax color for this language. A quick fix is to use the C# syntax with the command :set filetype=cs. That works but is not ideal, ideal is to install a vim.syntax file, and there is one available on this GNOME Live! page.

First download the file from this page and save it under ~/.vim/syntax. Next at the following lines to your ~/.vimrc file:
" Filetypes
augroup filetypedetect
        au! BufRead,BufNewFile *.vala,*.vapi setfiletype vala
augroup END

augroup vala
        autocmd BufRead *.vala,*.vapi set tw=100 efm=%f:%1.%c-%[%^:]%#:\ %t%[%^:]%#:\ %m
augroup END

Tag List

Tag List is a powerful plugin that lets you explore classes or functions from a source file, also called a source code browser. The installation steps are simple, they are also available bellow, and again to get it working with Vim there is a small hack to include inside the ~/.vimrc file.

First download the latest version of taglist from this page. Than uncompress the archive with, for example, the command line: 
unzip -x taglist_45.zip -d $HOME/.vim/
Than go inside ~/.vim/doc, run Vim and inside Vim execute the command :helptags .: 
cd ~/.vim/doc
vim
:helptags .
Finally add the following lines inside ~/.vimrc: 
" Work-around Tag List for Vala
let tlist_vala_settings='c#;d:macro;t:typedef;n:namespace;c:class;'.
  \ 'E:event;g:enum;s:struct;i:interface;'.
  \ 'p:properties;m:method'

Now Vim is ready for Vala, and it's possible to browse source code by typing the command :TListToggle.

Screenshot of Vim Vala Tag List
Vim Vala Tag List

Questions after the 4.10 release

Xfce

A short post to answerer some questions I’ve ready in comments on the 4.10 release news across the internet. If you have more questions, let me know in the comments and I’ll try to answer them.

A new stable release after 16 months? And no 4.8.1 release…

This is because Xfce has a different release model than for example GNOME or KDE when it comes to stable releases. Because of the limited team of developers we want to spend the least time possible on releasing packages. Big stable releases like other desktops do consume a lot of time, even with the small-ish amount of core packages in Xfce.

Therefore after 4.6 the following was decided: we only do 4 big releases (3 preview releases and 1 stable release) and after that only stable releases for individual packages. So the desktop version is 4.10 (notice the lacking micro-number), individual components could have higher 4.10.x numbers.

As an example, the last 4.8 stable release of xfce4-dev-tools is 4.8.0, the same as in the 4.8 fat-tarball release. The latest 4.8 release of xfce4-panel is 4.8.6 (6 stable releases after 4.8.0, which was in the 4.8 fat-tarball).

We know this is harder for starting users, who prefer to grab 1 tarball with all the latest versions, but instead need to crawl through /src/xfce and need to find the latest version. For distributions this is a lot easier: packagers are subscribed to the xfce-announce mailing list or peek identi.ca and once in a while they need to update 1 of the packages.

Nonetheless this is still a point where we can improve so I’ll see if I can provide more information on the website (announcements and links to the latest package versions).

4.10 only had 2 preview releases, because no critical bugs appeared and translations were in a good shape. Enough reasons for me to skip pre3 and release 4.10 instead.

Online Documentation Wiki

Just to be clear about this: we understand online docs are not a solution, but it was the best we could do in a short time. Hopefully the wiki-based setup will attract more contributors (who previously feared docbook or mallard, yes we tried that too) and lead to a complete set of documentation . When we feel satisfied with the content of the wiki we’ll look into a “wiki snapshot” for offline usage and ship that in an xfce4-docs package.

Gtk3

First 2 things: no Xfce 4.10 is not using gtk3, only the gtk-xfce-engine theme engine supports gtk3. Secondly we will discuss if Xfce 4.12 will be ported to gtk3. I’ll explain the latter:

Technically gtk3 is nothing different then gtk2 when it comes to programming. The hard parts are porting of some custom widgets (drawing and size allocation), replacements of some deprecated symbols and link to gtk3 libs. All things a user is not going to notice if we do it right.

Gtk3 is also not faster than gtk2, maybe there are some areas were it got a bit faster, but so there are areas where performance decreased a bit. Nothing shocking here.

An issue I’m aware of is theming issues in gtk3. From what I understand this changed back and forward in gtk 3.0, 3.2 and 3.4. So we need to decide which version we require to get this working consistently, because people will complain if only the Raleigh theme can be used :).

From the Xfce point of view there is (again) the resource problem for porting all plugins, because if for example the panel is ported to gtk3, also the plugins need to be ported. Not all goodies are maintained, but usually they work and distros can compile them. If in 4.12 suddenly 50% of the external plugins are not working that will be another thing users will notice.

At any rate, don’t get overly excited about gtk3, it’s just gtk 2.26 with a huge api break :). Once we decided which version we use in 4.12, I’ll post it on the blog.

LXDE still consumes less memory

*sigh* I’m not going to rant on this because as a user you should choose the desktop that makes you happy, but anyway it annoys me a tiny bit. So just to throw some information:

LXDE and Xfce are both based on the same toolkit and provide roughly the same set of features. That as a start makes it technically almost impossible to be much better or worse regarding memory usage. I think this whole myth started by comparing two distributions (clue: strcmp (distro_a + 1, distro_b + 1) == 0).

I’m sure Xfce consumes a bit more memory, because more processes are started. Especially when external plugins are added to the panel: a design decision to make the panel more stable.

I don’t know or care where this comparison started, but if somebody does this again the the future, please compare the actual memory usage and don’t use free. Or even better: don’t compare memory usage at all because it is pretty useless.
That said: if I start a default LXDE and Xfce 4.10 desktop (default Arch Linux packages) and use ps_mem.py, Xfce consumes 2 MiB more memory (same or desktop-equal applications are started). Do whatever you want this is number, as long as you compare apples and apples.

Not much accomplished in over 1 year

Sorry, I also work the entire week. But I don’t blame myself, Xfce is a fun project for all of us and if people move to another country, have a day job, a life, school/exams or simply don’t feel like working on Xfce not much progress is made.

Personally I don’t have the feeling not much was done in 4.10, we didn’t break anything major and a lot of the todo’s for 4.10 were completed in the release cycle. The focus was polishing and that’s what we did!

Updates:

  • 01-05 13:34: Added “Not much accomplished in over 1 year”.

Xfce 4.10 released!

Xfce

Today, after 1 year and 4 months of work, we are pleased to announce the release of the Xfce desktop 4.10, a new stable version that supersedes Xfce 4.8.

In the 4.10 cycle we mainly focused on polishing the desktop and improving the user experience in various ways. Highlights of this release are:

  • A new application finder that has been completely rewritten and combines the functionality of the old xfce4-appfinder and xfrun4.
  • The panel now has an alternative vertical display mode (a deskbar). What is more, panel plugins can be arranged in multiple rows, which is particularly useful in the deskbar mode.
  • A new MIME type editor that allows you to easily change applications used for opening different file types. The mouse and touchpad settings dialog and the settings editor were extended in terms of functionality. The former now supports tablets in a much better way.
  • It is now possible to launch applications and open files on the desktop with a single click of the mouse. In addition, the 4.10 desktop can display thumbnails and automatically advance through the wallpaper list.
  • The window manager can be configured to tile windows when dragging them to the screen edges. The tab window (Alt+Tab) supports more flexible theming and cursor key navigation.

An online tour of the changes in Xfce 4.10 can be viewed here:

http://xfce.org/about/tour

A detailed overview of the changes compared to Xfce 4.8 and Xfce 4.10 preview releases can be found on the following page:

http://xfce.org/download/changelogs

This release can be downloaded either as a set of individual packages or as a single fat tarball including all these individual versions:

http://archive.xfce.org/xfce/4.10

Thank you all the contributors, bug reporters, as well as translators and packagers for your efforts in making this release possible.

Best regards,
The Xfce development team

Techie TODO

Software, ,

In no particular order.

  • Start blogging again.
  • Suck less at Javascript, even if it’s a shitty language.
  • Learn jQuery, even if it’s just a library to make a shitty language less shitty.
  • Learn Rails properly.
  • Get back into open source dev.
  • Find a project/idea I can potentially monetize, and build and launch it.
  • Throw out my website entirely and start from scratch.
  • Stop running MacOSX all the time on my laptop and get back to using Linux as my primary desktop OS.

Xfce 4.10pre2 released!

Xfce

Xfce 4.10pre2 is now available for download.

It includes the following releases of Xfce core components:

  • exo 0.7.3
  • garcon 0.1.12
  • gtk-xfce-engine 2.99.3
  • libxfce4ui 4.9.2
  • libxfce4util 4.9.1
  • thunar 1.3.2
  • thunar-volman 0.7.1
  • tumbler 0.1.24
  • xfce4-appfinder 4.9.5
  • xfce4-dev-tools 4.9.2
  • xfce4-panel 4.9.2
  • xfce4-power-manager 1.1.0
  • xfce4-session 4.9.1
  • xfce4-settings 4.9.5
  • xfconf 4.9.1
  • xfdesktop 4.9.3
  • xfwm4 4.9.1

Individual tarballs are available for download now:
http://archive.xfce.org/xfce/4.10pre2/src

A tarball including all individual releases can be downloaded here:
http://archive.xfce.org/xfce/4.10pre2/fat_tarballs

Release notes for 4.10pre2

The Xfce development team is proud to announce the second preview release for Xfce 4.10. Together with this preview release, the Xfce project announces the string and code (only critical bug fixes or regressions) freeze for the final 4.10 release which is set to be pushed out to the world on April 28th, 2012.

This release incorporates some new features like improved responsiveness of file operations in Thunar and tiling improvements in Xfwm4. Everything else is bug fixes and a _lot_ of translation updates.

A list of all changes is available on:
http://xfce.org/download/changelogs/4.10pre2

We hope you will enjoy this release. Please give us feedback by sharing your thoughts, blogging, tweeting or by filing bug reports! With your help, 4.10 will be the best release ever (at least until 4.12)!

Kind regards and thanks to everyone who has contributed to this release,
The Xfce development team

We’re still looking for mirrors

Xfce

Since we’re using MirrorBrain to distribute the Xfce packages a number of good mirrors were collected. However, as you can see in the picture below, South America and Asia are not covered with good local mirrors.

So I you have the possibility to become and Xfce mirror located in these continents, please read this page!

Xfce 4.10pre1 released!

Xfce

Xfce 4.10pre1 is now available for download.

It includes the following releases of Xfce core components:

  • exo 0.7.2
  • garcon 0.1.11
  • gtk-xfce-engine 2.99.2
  • libxfce4ui 4.9.1
  • libxfce4util 4.9.0
  • thunar 1.3.1
  • thunar-volman 0.7.0
  • tumbler 0.1.24
  • xfce4-appfinder 4.9.4
  • xfce4-dev-tools 4.9.1
  • xfce4-panel 4.9.1
  • xfce4-power-manager 1.0.11
  • xfce4-session 4.9.0
  • xfce4-settings 4.9.4
  • xfconf 4.9.0
  • xfdesktop 4.9.2
  • xfwm4 4.9.0

Individual tarballs are available for download now:

http://archive.xfce.org/xfce/4.10pre1/src

A tarball including all individual releases can be downloaded here:

http://archive.xfce.org/xfce/4.10pre1/fat_tarballs

Release notes for 4.10pre1

The Xfce development team is proud to announce the first preview release for Xfce 4.10. Together with this preview release, the Xfce project announces the feature freeze for the final 4.10 release which is set to be pushed out to the world on April 28th, 2012.

This release incorporates major changes to the core of the Xfce desktop environment and hopefully succeeds in fulfilling a number of long time requests. Among the most notable updates is the new application finder that merges the functionality of the old appfinder and xfrun4. The Panel also has a new vertical mode [aka Deskbar] for better space usage on wide-screen monitors and a new actions plugin. On the settings side the settings helper is integrated in xfsettingsd, saving 1 running process. There is also a reworked settings dialog with categories and pluggable dialogs enabled by default. Basic Synaptics and Wacom settings in the Mouse settings and a new MIME-Type editor. Thunar gained a more polished layout to reduce space usage and more responsive interaction with the thumbnail generator. Because we have not decided on how to merge the desktop functionality into Thunar yet, Xfdesktop has instead received various improvements, including single-click support, desktop icon thumbnails and better pasting of files. The Session Manager has improved power management code, tips have been removed and cleanup sessions from the interface. Last but not least, the Window Manager now has support for tiling windows and arrow key navigation in the task switcher.

Another big change for users is the removal of user documentation of the packages and introduction of http://docs.xfce.org. The reason for this change is the limited contribution of documentation since Xfce 4.8, so we hope the wiki will attract more contributors. The help buttons in the interface still work, but you’ll be asked to open the documentation website in your web browser.

Furthermore we dropped xfce-utils. Its content has either been removed or moved to other Xfce packages. All other dependency changes are listed in the 4.10pre1 ChangeLog. The Xfce core also gained a couple of new components because we think they are critical for a minimal desktop: xfce4-power-manager (power management), tumbler (thumbnail generation for Thunar and other components), garcon (menu library, was already a dependency in 4.8), thunar-volman (volume manager for Thunar).

Of course translations also improved a lot, thanks to the amazing work of our translation teams.

A list of all changes is available on:

http://xfce.org/download/changelogs/4.10pre1

We hope you will enjoy this release. Please give us feedback by sharing your thoughts, blogging, tweeting, denting or by filing bug reports. With your help, 4.10 will be the best release ever (at least until 4.12)!

Kind regards and thanks to everyone who has contributed to this release,
The Xfce development team

RAW files with ristretto – (GtkPixbufLoader mimetype recognition bug)

image, ristretto, Xfce

In the release-notes for ristretto 0.3.5 last weekend, I mentioned the following:

Most problems with ristretto are actually caused by incorrect mime-type recognition
of the operating-system, identifying raw files (like canon’s CR2 format) as TIFF files.
This will result in an error from the tiff loader, these errors are now displayed in the UI,
making it possible to identify the source of the problem.

Since I could not understand why this happened, I started investigating the problem a bit further.

So, I executed the following commands on my system:

$ mimtype IMG_6635.CR2
IMG_6635.CR2: image/x-canon-cr2
$ file IMG_6635.CR2
IMG_6635.CR2: Canon CR2 raw image data, version 2.0

In my defense, I have seen it return image/tiff in the past, but clearly that was not the case right now. Both commands returned image/x-canon-cr2 just fine.

But opening the raw-files with ristretto (with the libopenraw-gnome backend installed), still gave me TIFF image-loading errors.

So something else must be causing the problems. Apparently, the OS determines the mimetype just fine, but something inside ristretto does not. Checking the source I discovered I was using gdk_pixbuf_loader_new(), which creates a pixbufloader that automagically determines the mimetype based on the stream of data you feed it.

So, I replaced that with a call to gdk_pixbuf_loader_new_with_mime_type (mime_type, NULL) and retrieved the mimetype using GFileInfo.

The commit that fixes this problem is 8dd741057f7b935d8e7c327017d850388ba77767, you can cherry-pick it and install libopenraw-gnome to support the rendering of raw files  inside ristretto.

NOTE:
Libopenraw-gnome is still under active development and rendering-bugs can occur. – When the image looks bad, this is not a bug in ristretto, it is probably some terrible photography ;-), or maybe something is not yet fully implemented in libopenraw-gnome.
Using git-master this weekend did not result in any usable whitebalance or exposure compensation for me.

FOSDEM 2012

community, conference, fosdem, releases, talks, thumbnails, tumbler, Xfce, xfce4-settings, , , , , , ,

This year’s FOSDEM is over and I hope that most of us have by now recovered from an exhausting weekend that was first and foremost exciting and a lot of fun! With about 12 people, the Xfce group was—I think—larger than ever before. Add to that a fairly large number of my colleagues from Codethink, into which I bumped at the beer event and FOSDEM itself from time to time. Despite mostly staying with Xfce, I enjoyed knowing and meeting people all over the place.

Unfortunately, some of us—myself included—missed half of the beer event because our trains and planes arrived late. Snow in Brussels, a cold weekend ahead. When we arrived at the Delirium Café at around midnight, I was glad to see that all the others had already made friends again. Olivier, Stephan, Peter, Nick, Simon, Christoph, everyone was there, some of them sufficiently drunk, I imagine. Although to be be fair, you wouldn’t really notice. Most of us left not to long after that in order to be in a good condition in the morning. Having only caught up half on drinking, Christian, Mike and I ended up staying at the Delirium with a few Codethink colleagues including Sam, Luc and Javier—until they finally kicked us out at around four in the morning.

Food, taxi, 2 1/2 hours of sleep later and we were sitting in the hotel, enjoying a fantastic buffet breakfast. Admittedly, I couldn’t eat that morning, ending the night in the Delirium had lead to quite a strong hangover. After the majority of us had gathered in the hotel lobby, we squeezed ourselves into the 71 bus in two groups and finally arrived at FOSDEM. I do not remember the details of the day, but it was a great mix of talks (including my own one about Tumbler, which I felt was not very special, picture below), chatting and minor hacking (at least on my side; Nick made good progress with the settings editor in the meantime). During the day, Jean-Francois, Jens and Mark joined us and we (or most of us at least) ended the day having food in a Vietnamese restaurant close to the hotel and a beer in the hotel lobby.

Sunday was similar, except that I could finally enjoy the breakfast. Lovely. Unfortunately, we didn’t manage to get everyone together anymore, so our initially large group was now split up into smaller ones for the rest of Sunday. We still managed to have a few technical chats about Xfce that day and made a few decisions (see below). Regards talks, I mostly remember the Wayland Q&A session and a talk about social engineering in free software communities, Most of us left in the afternoon or evening. I met up with Luc, Sam, Javier and a bunch of other people to have food in a very nice restaurant. Got up at six in the morning, walked to the central station, took a plane home from the airport and went back to work in the afternoon. Unlike a few others I seem to have escaped the typical illnesses (cold, broken sleep cycles, general exhaustion) that events like FOSDEM always bring along.

Xfce-Related News — Fresh from FOSDEM

Wayland was big this year. I will spare you the details of how it works. Throughout the weekend, we had various discussions that involved Wayland. While it may take some load of Olivier by eventually making window managers obsolete, there is still a major problem with it: it does not support the XEmbed protocol, and therefor will break pluggable settings dialogs and panel plugins. We have sent mails to the wayland-devel list to find out how they feel about this. For now, I suppose this is all we can do.

Reorganization of the settings dialogs

One thing we decided on Sunday was to reorganize the settings dialogs so that the location of particular types of settings becomes more predictable. This applies to appearance and window manager themeing, and the application keyboard shortcuts and window manager keyboard shortcuts in particular. We will rearrange some of these tabs and merge them so that all related settings are in one place. We will also merge the window manager and window manager tweaks dialogs into one.

Release Schedule for Xfce 4.10

Despite a lack of completed features in Thunar (which are unlikely to get finished before 4.10), there are only a few things that really keep us from releasing Xfce 4.10. We have not decided on a release date, but if things go well, we should be able to roll the first pre-release one month from now, in early March. This would mean that a final release in May or June would be feasible.

Possibility of a hackfest

Meeting up with the team is always great fun. Unfortunately, FOSDEM is a busy event and only lasts two days. Like last year, we discussed the possibility of an Xfce hackfest in the future. I would love to see this idea becoming reality. If half a dozen of the relevant people can make it for at least a couple of days, this could greatly benefit the development of Xfce. Ideally, such a hackfest would span over at least 4-5 days, ideally including a weekend to make it easier to attend for people with jobs. Given a relatively small group, it might even be possible to hold an event like this at someone’s flat. This is definitely something that we will look into soon.

Like every year, FOSDEM 2012 was a great event. And like every year, a few more nicknames have turned into real faces that, unsurprisingly, belong to incredibly friendly human beings! I only wish that we had more time to discuss things face to face and do some serious work on Xfce together. In any case, this calls for another iteration next year. And with that, I shall end this wrap-up.